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I ntroduction 

The Individuals with Disabilities Education Act (IDEA) of 2004 established a requirement 
that all states develop and submit to the U.S. Department of Education, Office of Special 
Education Programs (OSEP) a performance plan designed to move the state from it current 
level of compliance with the statutory and regulatory requirements of the law and to 
improve the educational and functional outcomes for children with disabilities. The state 
plan must encompass baseline data (where available), projected targets, and activities to 
achieve those targets. The state is required to submit an annual report in the years 
following the submission of the performance plan to inform OSEP and the public on the 
progress toward meeting those goals. This document fulfils the first step of that process - 
the State Performance Plan. 

Overview of the State Performance Plan (SPP) Development 

The Colorado State Performance Plan was drafted internally by staff at the Colorado 
Department of Education, Exceptional Student Services (CDE/ESSU) with input from the 
Colorado Special Education Advisory Council (CSEAC) and local special education 
directors. The specific tasks requested of these groups were: 

• Consider baseline and trend data for each indicator where such information was 
available; 

• Assist in determining appropriate targets for each indicator where a target was 
required for the SPP; 

• Suggest activities that will assist local administrative units and the ESSU in 
meeting the targets; 

• Review the planned activities, timelines, and resources and provide input into the 
likely efficacy of the strategies proposed. 

In addition to the formal input process undergone with the CSEAC and special education 
directors, CDE/ESSU included a smaller working group of representatives from each of 
these organizations for ongoing input into the SPP process, indicators, and activities. 

Following the submission of the State Performance Plan to the U.S. Department of 
Education, CDE/ESSU will post the final version on the department website and will alert 
constituency groups of its availability via existing list serves. Hard copies will be 
provided to all CSEAC members and special education directors as well as any individual 
making a request for one. Public notice about the availability of the SPP will be made in 
the CDE/ESSU newsletter and the PEAK Parent Center Newsletter. 

Colorado maintains accountability systems for all public education administrative units 
and state operated programs. Administrative units include school districts and Boards of 
Cooperative Educational Services (BOCES). BOCES consist of groups of school districts 
with fewer than 4000 students or 400 students with disabilities unless they have a 
variance from the department to operate with fewer students. Charter schools are the 
responsibility of the administrative unit under which they are chartered. Therefore, 
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throughout this document the term Administrative Unit will be used to reflect the local 
education agency. 

Overview of State Initiatives Intended to Drive Improvement on Multiple 
I ndicators: 

Continuous I mprovement Monitoring Process (Cl MP) 

CIMP is a collaborative process that supports a seamless system within Colorado to 
ensure that federal and state laws are appropriately implemented for the learning and 
growth of exceptional children. It relies on using meaningful and multiple sources of 
data, such as parent survey data, staff survey data, graduation rates, dropout rates, a 
review of student records and the performance of students with disabilities on state and 
local assessments to gauge effectiveness of special education supports and services. 
See overview of Indicator 15 for more details. 

Transition Outcomes Project (TOPS) 

The Transition Outcomes Project is a voluntary program for local school districts or 
administrative units to raise awareness about transition issues. The project includes an 
I EP record review to look at transition services and how those services are documented 
on the IEP. Data obtained through this program is used to create and expand services 
and supports and cannot be used to cite non-compliance. 

Results Matter 

Results Matter is a federally funded grant focused on child and family outcomes for the 
early care and education system 0-5 managed through Part C, Part B 619 and Colorado 
Preschool Program. Staff from the Department of Education have coordinated the effort 
of identified stakeholders in the outcomes measurement system development process 
and has engaged the various stakeholders over the past 16 months. The state has 
determined a finite list of four tools or assessment systems that are curriculum 
referenced with a stand alone child outcome assessment format. Programs will be 
phased in around the state during 2006-2007 depending on when direct service 
providers receive training. Initial statewide training will be complete late 2006. Programs 
in the first stage of training will begin collecting data on children in Spring 2006. 
Technical assistance and follow-up support will be provided by state Part C, Part B/619, 
Colorado Preschool Program and Early Childhood Initiatives staff and contract staff 
beginning in 2006. 

Positive Behavioral Supports (PBS) 

School wide PBS is a broad range of systemic and individualized strategies for achieving 
important social and learning outcomes while preventing behavior problems in all 
students. The purpose of the Colorado School-wide Positive Behavior Supports Initiative 
is to establish and maintain effective school environments that maximize academic 
achievement and behavioral competence of all learners in Colorado. This is a voluntary 
program for local school districts or administrative units. 

State I mprovement Grant. ( Si G) 

The goals of the five year CDE- State Improvement Grant (SIG) are l)to increase 
teachers and speech/language pathologists with fully certified credentials and 2) to 
improve the use of positive behavior interventions thereby reducing discipline referrals, 
suspensions and increasing academic achievement. A variety of scientifically based 
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research knowledge and training strategies are being employed to attain these goals. 
These include: 

• Develop and enhance aggressive recruitment strategies to increase certified 
personnel so that at the end of five-years, Colorado LEAs and state- approved 
facilities will increase the fully licensed special education teachers from 78% to 
100 %. 

• Increase the training/retraining activities specifically aimed at special education 
teachers who are not fully licensed and now teaching within LEA. 

• Expand the in- and out-of-state training capacity so that all speech and language 
pathologist vacancies within LEAs can be filled with fully licensed professionals. 

• Target the reduction of special education teacher attrition through staff 
development, coaching, mentoring, and increased administrative support. 

• Implement positive behavior supports in LEAs having the highest suspension 
rates using a three-phase process of 1) Awareness, 2) Readiness, and 3) 

I mplementation. 

• Develop and implement the necessary state infrastructure to support a statewide 
continuing positive behavior support initiative. 

Response to I ntervention (RTI ) 

CDE-ESSU provides guidance for administrative units who implementing, or considering 
implementing, an RTI model. CDE is working closely with the Regional Educational 
Service Teams to educate general educators as well as superintendents and 
administrators on the RTI model. CDE guidance has been based on a building self- 
assessment tool to roll out RTI building by building as schools are ready rather than 
requiring whole districts be ready to begin the initiative. 

English Language Learners with Exceptional Needs (ELLEN) 

The ELLEN project provides guidance to administrative units regarding an eight step 
process for accurately identifying ELL students that may have exceptional needs. This 
process also overlaps with the RTI initiative. Resources include regional training and a 
tool kit to assist the process. 

School District Accreditation 

CDE, through its Regional Services Teams are responsible for accrediting all school 
districts annually under Colorado State law. School districts are then responsible for 
accrediting their individual schools. There are eleven indicators for accreditation which 
include a district improvement plan, performance on statewide assessment 
(CSAP/CSAPA), data on how districts are closing the learning gaps with various 
populations, value added growth performance( 1 years progress in 1 years time), 
implementation of standards based curriculum, compliance with the schools' 
accountability reports compliance with educational accreditation, compliance with safe 
schools act, and compliance with the Colorado Basic Literacy Act. The ESSU is working 
closely to ensure that special education is included and that special education non- 
compliance is tied to accreditation. 
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Table 1. Potential Impact of Cross-Cutting Statewide Initiatives on Individual 
I ndicators. 
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Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: FAPE in the LRE 



For FFY 2008 the measurement for Indicator 1 was changed to align with the reporting 
required under the Elementary and Secondary Education Act (ESEA). The Indicator now 
reads: 

I ndicator 1: Percent of youth with I EPs graduating from high school with a regular 
diploma. 

(20 U.S.C. 1416 (a)(3)(A)) 



Measurement: States must report using the graduation rate calculation and timeline 
established by the Department under the ESEA. 

Data Source: Same data as used for reporting to the Department under Title I of the 
Elementary and Secondary Education Act (ESEA). 

* Colorado will calculate the on-time graduation rate for all students beginning with data 
from FFY2009- 10. 



It is important to note that the ESEA calculation does not include Colorado's students in 
special settings - State Operated Programs (SOPs), Eligible Facilities, or students in private 
schools receiving services on an ISP. The I DEA definition includes all of these students. 



Overview of Issue/ Description of System or Process 

In Colorado, local school boards are responsible for establishing the requirements for 
high school graduation for all students. There is no statewide definition. Graduation 
requirements vary from district to district and the State considers a graduate to be any 
student who has met the requirements of his or her local school district. To ensure that 
district practices do not discriminate against special education students, districts must: 

• establish clearly defined graduation and diploma requirements that include 
specific, objective criteria and are available to all students, 

• provide appropriate advance notice to allow reasonable time to prepare to meet 
the requirements or make informed decisions about alternative options, 

• and, consider the needs of individual students on a case-by-case basis. 

While a district can offer different types of diplomas, these options must be available to 
all students regardless of whether the student has a disability. Diplomas may not be 
designated for a specific student population or based on special education status. 
Therefore, the definition of "graduate" for general and special education students is 
reasonably similar at the state level. Some districts also offer a "certificate of 
completion" as an option, however, the State does not consider these students 
graduates for state level reporting. 
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For calculating graduation rates the following calculation is used: 



Number of students with disabilities receiving a regular diploma 
during the 2007-2008 school year 



(Number of students with disabilities finishing 8 th grade in 2003-2004 
+ (Number of transfers in) - (Number of verified transfers out) 



Baseline data was established on the method for calculating graduates based on IDEA. 
Baseline data will be re-established when Colorado moves to an on-time graduation rate 
calculation in FFY 2009. 



Baseline Data for FFY 2004 (2004-2005) 

Graduation Rate of Students with Disabilities: 52.9% of Exiters aged 14-21Years 

[N = 2,799/5,288] 

Graduation Rate of Students without Disabilities: Not comparable 



Discussion of Baseline Data 

In previous Annual Performance Reports submitted to OSEP, the CDE did not include the 
category "Transferred, Not known to be Continued” in the calculation of graduation 
rates. Based on the most recent guidance from OSEP, the CDE has adjusted the 
calculation so that this category is properly reflected in the calculation. Figures 1 and 2 
show the eight year graduation rate trends and projected targets based on the old and 
new methods, respectively. The use of the "transferred, not known to be continuing” 
category has increased substantially over the past several years and appears to be 
undermining the precision of graduation and dropout rates. Stakeholder groups have 
acknowledged the difficulties with following up with these students and believe that a 
large percentage of these students are not, in fact, dropouts. The CDE intends to use 
existing forums and develop technical assistance to improve the ability of administrative 
units to better follow-up with students so that the designation is more accurately 
applied. 
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Figure 1. Graduation Rates (Old Method) for Students on I EPs and Projected 
Targets (in Yellow). 




Figure 2. Graduation Rates (New Method) for Students on I EPs and Projected 
Targets (in Yellow). 




In accordance with the measurement change, targets reported in the Annual 
Performance Report are those targets established by ESEA by the CDE Office of Federal 
Programs Administration. Targets reported are not specifically designated as graduation 
rates for students with disabilities but are targets to be reached by all groups of 
students. 
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FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 


57 . 40 % 


2006 

(2006-2007) 


57 . 40 % 


2007 

(2007-2008) 


57 . 40 % 


2008 

(2008-2009) 


59 . 50 % 


2009 

(2009-2010) 


59 . 50 % 


2010 

(2010-2011) 


59 . 50 % 
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I mprovement Activities/ Timelines/ Resources 

In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 










o= 


Ongoing 


f 








C = Complete; 








R=l 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


1. 1 mprove consistency 


FFY 2006 


Regional trainings for End of 




c 






between Alls in methods 


FFY 2007 


Year (EOY) data collection and 










of reporting graduation 


at state special education 










and dropout rates. 




Directors' meetings were 
provided. 














The special education data 
group continues to work with 
the general education data 
group on aligning data 
definitions and codes. 










2. Improve tracking of 


FFY 2006 


The CDE determined this to be 








D 


students who transfer to 


FFY 2007 


an ongoing administrative task 










other educational 


rather than an improvement 










settings. 


FFY 2008 


activity targeted at improving 
results so it is being deleted. 










3. Expand the Positive 


FFY 2007 


Data are not available to 








D 


Behavioral Supports 




confirm the impact of PBS on 










(PBS) program. See 
discussion under 
1 ndicator 4a for further 
detail. 




graduation rates. 










4. Train and monitor for 


FFY 2006 


Training in on-going and is 


O 








effective transition plans 


FFY 2007 


delivered statewide, regionally, 








and progress reporting. 


and individually as requested 










See activities under 
Indicator 13 for more 
details. 


FFY 2008 
FFY 2009 
FFY 2010 


by Aus. 
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Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C = Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


5. Change the reporting 
period for tracking 
graduation and dropout 
rates for special 
education students using 
J uly 1 - J une 30 as the 
reporting period. 


FFY 2006 


This change was implemented 
with the FFY 2006 End of Year 
(EOY) report submissions. 




c 






6. Use the Continuous 
1 mprovement and 
Monitoring Process 
(Cl MP) process to 
identify districts with 
significant discrepancy 
from state rates. 


FFY 
2006 
FFY 2007 


Regional liaisons worked with 
Special Education Directors to 
analyze data. 




c 






7. Expand the Transition 
Outcomes Project 
(TOPS). See activities 
under Indicator 13 for 
additional details. 


FFY 2007 
FFY 2008 
FFY 2009 
FFY 2010 


TOPS, developed by Ed 
O'Leary, has been modified to 
become TOPS Lite. The 
program has been offered to 
individual AUs, as well as one a 
regional basis. The focus has 
been on the relationship 
between meaningful transition 
1 EPs and Indicators 1, 2, 13 
and 14. 


O 








8. Align statewide 

calculation of graduation 
rates for students with 
and without disabilities 
using cohort approach. 


FFY 2008 


The CDE determined this to be 
an ongoing administrative task 
rather than an improvement 
activity targeted at improving 
results so it is being deleted. 








D 


9. Revise the SPP/ APR 
baseline, targets, and 
activities to reflect 
revised graduation and 
dropout calculations. 


FFY 2009 


The CDE determined this to be 
an ongoing administrative task 
rather than an improvement 
activity targeted at improving 
results so it is being deleted. 








D 
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Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C = Complete; 
R= Revised; 

D = Deleted 


O 


C 


R 


D 


10. Develop a strategy to 
systematically assess 
risk factors for dropping 
out among special 
education students. 


FFY 2008 


This activity is being addressed 
in Indicator 2 improvement 
activities. 








D 


11. Utilize results from Post 
School Outcomes survey 
to further develop 
strategies that increase 
graduation rates. 


FFY 2008 


The data available do not relate 
to graduation/dropout rates. 








D 


12. Pilot dropout risk factor 
approach. 


FFY 2009 


This improvement activity is 
more appropriate under 
1 ndicator 2. 








D 


13. Full implementation of 
dropout risk factor 
assessment 


FFY 2010 


This improvement activity is 
more appropriate under 
1 ndicator 2. 








D 


14. Collaborate with 
Prevention Initiatives 
Unit, the Workforce 
Readiness Taskforce, 
and the System of 
Supports Taskforce to 
identify factors related 
to graduation and 
dropout rates and 
develop/ implement 
strategies and 
interventions to address 
the identified factors. 

Revised, see p.12, 

1 mprovement Activity 
#1. 


FFY 2008 


Many units within CDE are 
addressing this issue. 






R 
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Resources Used to Support Activities 

• CDE Exceptional Student Leadership Unit 

• CDE Data and Research Unit 

• CDE Prevention Initiatives Unit 

• Contractors/Vendors 

• Special Education Directors 

Revisions for FFY 2008 

The CDE is adding an improvement activity to continue through FFY 2010 

Revised I mprovement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. Collaborate with 

Prevention Initiatives Unit, 
the Workforce Readiness 
Taskforce, and the System 
of Supports Taskforce to 
identify factors related to 
graduation and dropout 
rates and to 
develop/ implement 
strategies and 
interventions that address 
the identified factors. 

Focus will be on strategies 
that utilize and coordinate 
all resources and 
supports, including the 
School to Work Alliance 
Program (SWAP). 


Form inter-departmental 
professional learning 
community. 

Assign an ESLU Secondary 
Services Team member to 
serve on statewide teams. 

Ensure SWAP personnel are 
directly involved in state and 
regional trainings to ensure 
alignment. 

Serve on the Dropout 
Prevention and Student 
Reengagement Committee to 
ensure priority and high- 
priority districts receive 
needed support through 
technical assistance to 
increase graduation rates for 
students with disabilities. 

Serve on the Individual 
Career and Academic Plans 
(ICAP) committee to ensure 
students with disabilities are 
included in the process. 


FFY 2009 
FFY 2010 


ESLU 

Prevention 
1 nitiatives 
Dropout 
Prevention 
Office 

Department 
of Vocational 
Rehabilitation 
and the SWAP 

ESLU 

Prevention 
1 nitiatives 
Unit 

ESLU 

Office of 
Teaching and 
Learning 
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Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: FAPE in the LRE 

For FFY 2008 the measurement for Indicator 2 was changed to align with the reporting 
required under the Elementary and Secondary Education Act (ESEA). The Indicator now 
reads: 

I ndicator 2: Percent of youth with I EPs dropping out of high school. 

(20 U.S.C. 1416 (a)(3)(A)) 



Measurement: States must report using the dropout rate calculation and timeline 

established by the Department under the ESEA. 

Data Source: Same data as used for reporting to the Department under Title I of the 

Elementary and Secondary Education Act (ESEA). 



It is important to note that the ESEA calculation does not include Colorado's students in 
special settings - State Operated Programs (SOPs), Eligible Facilities, or students in private 
schools receiving services on an ISP. The I DEA definition includes all of these students. 

For calculating drop out rates, the following calculation is used: 

Number of students who dropped out during the 2007-2008 school year 

Total number of students who were part of the same membership base 
at any time during the 2007 - 2008 school year 



Baseline data was established on the method for calculating drop out rates based on the 
IDEA definition of a drop out. Baseline data will be re-established when Colorado moves to 
an on-time graduation rate calculation in FFY 2009. 



Baseline Data for FFY 2004 (2004-2005) 

All Youth Dropout rate: Not Comparable 

Special Education Dropout rate: 40.7% of Exiters aged 14-21 Years 

[N = 2,153/5,288] 

Discussion of Baseline Data 

In previous Annual Performance Reports submitted to OSEP, the CDE did not include the 
category "Transferred, Not known to be Continued" in the calculation of dropout rates. 
Based on the most recent guidance from OSEP, the CDE has adjusted the calculation so 
that this category is properly reflected in the calculation. Figures 3 and 4 show the eight 
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year graduation rate trends and projected targets based on the old and new methods, 
respectively. 



Figure 3. Dropout rates (Old Method) for Students on I EPs and Projected 
Targets (in yellow). 




Figure 4. Dropout rates (New Method) for Students on I EPs and Projected 
Targets (in Yellow). 
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In accordance with the measurement change, targets cannot be reported. The ESEA 
does not establish targets for drop out rates for students. Targets will be re-set in FFY 
2009 . 



FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 


40.5% 


2006 

(2006-2007) 


40.0% 


2007 

(2007-2008) 


39.5% 


2000 

(2008 2009) 


39.0% 


2000 

(2009 2010) 


38.5% 


2020 

(2010 2011) 


38.0% 
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I mprovement Activities/ Timelines/ Resources 

In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 










o= 


Ongoing 


f 








C= Complete; 








R= 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


1. 1 mprove consistency 


FFY 2006 


Regional trainings for EOY data 




c 






between Alls in methods 


FFY 2007 


collection, state special 










of reporting graduation 


education directors' meetings 










and dropout rates. 




were provided. 














The special education data 
group has been working with 
the general education data 
group on aligning data 
definitions and codes. 










2. Improve tracking of 


FFY 2006 


The CDE determined this to be 








D 


students who transferred 


FFY 2007 


an ongoing administrative task 










to other educational 


rather than an improvement 










settings. 


FFY 2008 


activity targeted at improving 
results so it is being deleted. 










3. Expand the Positive 


FFY 2007 


Data are not available to 








D 


Behavioral Supports 




confirm the impact of PBS on 










(PBS) program. See 
discussion under 
Indicator 4a for further 
detail. 




dropout rates. 










4. Train and monitor for 


FFY 2006 


Training is on-going and is 


O 








effective transition plans 


FFY 2007 


delivered statewide, on a 










and progress reporting. 


regional basis, and individually 










See activities under 


FFY 2008 


as requested by AUs. 










Indicator 13 for more 
details. 


FFY 2009 














FFY 2010 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 










o= 


Ongoing 


f 








C= Complete; 








R= 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


5. Change the reporting 


FFY 2006 


This change was implemented 




c 






period for tracking 




with the FFY 2006 End of Year 










graduation and dropout 
rates for special 
education students using 
J uly 1 - J une 30 as the 
reporting period. 




(EOY) report submissions. 










6. Use the Continuous 


FFY 2006 


Regional liaisons worked with 




c 






1 mprovement and 


FFY 2007 


Special Education Directors to 










Monitoring Process 
(Cl MP) process to 
identify districts with 
significant discrepancy 
from state rates. 


analyze data. 














7. Expand the Transition 


FFY 2007 


The Transition Outcomes 


O 








Outcomes Project 


FFY 2008 


Project (TOPs), developed by 










(TOPS). See activities 


Ed O'Leary, has been modified 










under Indicator 13 for 


FFY 2009 


to become TOPS Lite. The 










additional details. 


FFY 2010 


program has been offered to 
individual AUs, as well as on a 
regional basis. The focus has 
been on the relationship 
between meaningful transition 
lEPs and Indicators 1, 2, 13 
and 14. 










8. Align statewide 


FFY 2009 


The CDE determined this to be 








D 


calculation of graduation 




an ongoing administrative task 










rates for students with 




rather than an improvement 










and without disabilities 




activity targeted at improving 










using cohort approach. 




results so it is being deleted. 










9. Revise of the SPP/ APR 


FFY 2009 


The CDE determined this to be 








D 


baseline, targets and 




an ongoing administrative task 










activities to reflect 




rather than an improvement 










revised graduation and 




activity targeted at improving 










dropout calculations. 




results so it is being deleted. 
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Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


C 


R 


D 


10. Develop a strategy to 
systematically assess 
risk factors for dropping 
out among special 
education students. 

Revised, see p.20, 

1 mprovement Activity 
#1. 


FFY 2008 


A working relationship with the 
CDE Prevention Initiatives Unit 
has been established via an 
inter-unit professional learning 
community. 






R 




11. Utilize results from Post 
School Outcomes survey 
to further develop 
strategies that reduce 
dropout rates 


FFY 2008 


The data available do not relate 
to graduation/dropout rates 








D 


12. Pilot dropout risk-factor 
approach 

Revised, see p. 20, 

1 mprovement Activity 
#1 


FFY 2009 
FFY 2010 


This will be addressed in a 
revised improvement activity 






R 




13. 1 mplement dropout risk 
factor assessment 

Revised, see p. 20, 

1 mprovement Activity 
#1 


FFY 2009 
FFY 2010 


This will be addressed in a 
revised improvement activity 






R 




14. Use the Cl MP system to 
support the development 
of improvement plans for 
administrative units 
identified with high 
dropout rates. 

Revised, see p. 20, 

1 mprovement Activity 
#1 


FFY 2008 


This will be addressed in a 
revised improvement activity 






R 
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Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


C 


R 


D 


15. Collaborate with 
Prevention Initiatives 
Unit, the Workforce 
Readiness Taskforce, 
and the System of 
Supports Taskforce to 
identify factors related to 
graduation and dropout 
rates and 

develop/ implement 
strategies and 
interventions to address 
the identified factors. 

Revised, see p. 20, 

1 mprovement Activity 
#1. 


FFY 2008 


Many units within CDE are 
addressing this issue 






R 





Resources Used to Support Activities 

• CDE Exceptional Student Leadership Unit 

• CDE Data and Research Unit 

• CDE Prevention Initiatives Unit 

• Contractors/Vendors 

• Special Education Directors 
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Revisions for FFY 2008 

The CDE is adding an improvement activity to continue through FFY 2010 

Revised I improvement Activities/ Timelines/ Resources 



Activity 

1. Collaborate with 

Prevention Initiatives Unit, 
the Workforce Readiness 
Taskforce, and the System 
of Supports Taskforce to 
identify factors related to 
graduation and dropout 
rates and to 
develop/ implement 
strategies and 
interventions that address 
the identified factors. 

Focus will be on strategies 
that utilize and coordinate 
all resources and 
supports, including the 
School to Work Alliance 
Program (SWAP). 



Action Steps 


Timeline 


Resources 


Form inter-departmental 


FFY 2009 


ESLU 


professional learning 




Prevention 


community. 




1 nitiatives 


Assign an ESLU Secondary 




Dropout 


Services Team member to 




Prevention 


serve on statewide teams 




Office 


Ensure SWAP personnel are 




Department 


directly involved in state and 




of Vocational 


regional trainings to ensure 




Rehabilitation 


alignment. 




and the SWAP 


Serve on the Dropout 
Prevention and Student Re- 


FFY 2010 


ESLU 

Prevention 
1 nitiatives 
Unit 


engagement Committee to 
ensure priority and high- 
priority districts receive 
needed support through 
technical assistance to 
increase graduation rates for 






ESLU 


students with disabilities. 




Office of 


Serve on the Individual 
Career and Academic Plans 
(ICAP) committee to ensure 
students with disabilities are 
included in the process. 




Teaching and 
Learning 
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Colorado 



Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: FAPE in the LRE 



For FFY 2008 the measurement for Indicator 3 was changed to align with the reporting 
required under the Elementary and Secondary Education Act (ESEA). The Indicator now 
reads: 

I ndicator 3: Participation and performance of children with I EPs on statewide 
assessments: 

A. Percent of the districts with a disability subgroup that meets the State's minimum 
"n" size that meet the State's AYP targets for the disability subgroup. 

B. Participation rate for children with I EPs. 

C. Proficiency rate for children with I EPs against grade level, modified and alternate 
academic achievement standards. 

(20 U.S.C. 1416 (a)(3)(A)) 



Measurement: 

A. AYP percent = [(# of districts with a disability subgroup that meets the State's 
minimum "n" size that meet the State's AYP targets for the disability subgroup) 
divided by the (total # of districts that have a disability subgroup that meets the 
State's minimum "n" size)] times 100. 

B. Participation rate percent = [(# of children with I EPs participating in the 
assessment) divided by the (total # of children with I EPs enrolled during the 
testing window, calculated separately for reading and math)]. The participation 
rate is based on all children with I EPs, including both children with I EPs enrolled 
for a full academic year and those not enrolled for a full academic year. 

C. Proficiency rate percent = ([(# of children with I EPs enrolled for a full academic 
year scoring at or above proficient) divided by the (total # of children with I EPs 
enrolled for a full academic year, calculated separately for reading and math)]. 



Overview of I ssue/ Description of System or Process 

Colorado statewide assessment system is known as the Colorado Student Assessment 
Program (CSAP) and the alternate assessment measuring progress against alternative 
achievement standards is referred to as CSAPA. Grades tested in 2003-2004 were third 
through tenth. These are the same assessments used to report under the No Child Left 
Behind Act (NCLB). The CDE administers the CSAP or CSAPA to all students each year 
in grades 3 through 10. CSAP uses four categories to classify student proficiency level 
as follows: 

• Unsatisfactory 

• Partially Proficient 

• Proficient 

• Advanced 
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CSAPA uses five categories to classify student proficiency level as follows: 

• Inconclusive 

• Exploring 

• Emerging 

• Developing 

• Novice 



For determining adequate yearly progress (AYP) among districts and schools, the CDE 
examines the percentage of students scoring partially-proficient or above on CSAP, and 
Emerging or above on CSAPA. The number of Districts meeting the State's AYP 
objectives for progress for disability subgroup was calculated on the number having at 
least 31 students with disabilities in each school level, which is the same number used 
for the determination of AYP for all other students. 



Calculations: 

A. 22.7% = 17 districts meeting the State's AYP objectives for progress for the 
disability subgroup (children with lEPs) divided by 75 districts in the State which 
exceed Minimum N of 30 times 100. 

A. Participation Rate 

a. N = 44,282 (Reading) & 44,094 (Math) children with lEPs in grades 
assessed; 

b. N = 19,535 (Reading) & 20,944 (Math) children with lEPs in regular 
assessment with no accommodations (44.1% for Reading, 47.5% for Math); 

c. N = 20,643 (Reading) & 19,253 (Math) children with lEPs in regular 
assessment with accommodations (46.6% for Reading, 43.5% for Math); 

d. N = 0 (Reading) &0 (Math) of children with lEPs in alternate assessment 
against grade level standards (0% for Reading, 0% for Math); and 

e. N = 3,836 (Reading) & 3,760 (Math) of children with lEPs in alternate 
assessment against alternate achievement standards (8.7% for Reading, 
8.5% for Math). 

Overall Percent for Reading: 19,535 + 20,643 + 0 + 3,836 divided by 44,282 

= 99.4% 

Overall Percent for Math: 20,944 + 19,253 + 0 + 3,760 divided by 44,094 = 

99.6% 

B. Proficiency Rate 

a. N = 44,282 (Reading) & 44,094 (Math) children with lEPs in grades 
assessed; 

b. N = 11,674 (Reading) & 10,392 (Math) children with lEPs in grades 
assessed who are "Partially-Proficient" or above as measured by the regular 
assessment with no accommodations (26.4% for Reading, 23.6%% for 
Math); 

c. N = 10,075 (Reading) & 9,207 (Math) children with lEPs in grades assessed 
who are "Partially-Proficient" or above as measured by the regular 
assessment with accommodations (22.8% for Reading, 20.9%% for Math); 
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d. N = 0 (Reading) & 0 (Math) children with lEPs in grades assessed who are 
partially- proficient or above as measured by the alternate assessment 
against grade level standards (0% for Reading, 0% for Math); and 

e. N = 3,322 (Reading) & 2,942 (Math) of children with lEPs in grades 
assessed who are "Emerging" or above as measured against alternate 
achievement standards (7.5% for Reading, 6.7% for Math). 

Overall Percent for Reading: 21,749 + 0 + 3,322 divided by 44,282 = 56.6% 
Overall Percent for Math: 19,599 + 0 + 2,942 divided by 44,094 = 51.1% 



Baseline Data for FFY 2004 (2004-2005) 



AYP Rates for Districts with SWD 

Participation Rate for Reading: 
Participation Rate for Math: 

State Proficiency Rate for Reading: 
State Proficiency Rate for Math: 

Discussion of Baseline Data 



22.7% 

[17/75] 

99.4% 

99.6% 

56.6% (Partially-Proficient or Above) 
51.1% (Partially-Proficient or Above) 



The baseline and targets were revised in the February 2007 update to align the APR 
reporting process with the Table 6 Report of the Participation and Performance of 
Students with Disabilities on State Assessments by Content Area, Grade, and Type of 
Assessment completed by Colorado’s Assessment Unit and submitted to OSEP on a 
yearly basis. Also, at the time that the original FY2005 - 2010 SPP was written, the 
most recent assessment participation and performance data was from FY2003. The 
current adjustment of baseline and targets that aligns with Table 6 is based on FY2004 
data. 

This adjustment and alignment resulted in two major changes. First, baseline and 
targets are now based on participation and proficiency rates for grades 3 through 9 
instead of grades 3 through 10. Second, part (a) of the calculation for participation and 
proficiency rates, the number of students with lEPs in the assessed grades (3 through 
9), are now based on enrollment data as reported in Table 6 rather than the December 
Count data that was used in the initial development of baseline and targets for this 
indicator. The Table 6 enrollment counts by grade are determined using a time window 
with a much closer proximity to the testing period and therefore, are a more valid 
denominator for calculating participation and proficiency rates. 

These changes in calculating participation and proficiency rates resulted in the following 
changes to the baselines: 

• 2.8% increase in baseline Reading Participation 

• 5% increase in baseline Math Participation 
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• 1.8% increase baseline Reading Proficiency 

• 4.4% increase in baseline Math Proficiency 

Because these changes in the calculation resulted in participation rates that were so 
near 100%, no improvement in targets were projected for these two Measures until 
FY2008, at which point Colorado will have data from a system where standard and 
alternate assessments are merged into one test publisher. It is hoped that this merged 
system will allow for the accounting of 100% of students with lEPs with regard to their 
participation on assessments. 

For reading and math proficiency targets, no substantive changes to the magnitude of 
change over the life the SPP have been made. Only the baseline was changed to reflect 
the above mentioned changes in calculating reading and math proficiency rates. 

No changes were made in AYP Rate calculations, baseline or targets from the SPP 
submitted in December of 2005. 



The updated Measurable and Rigorous Targets table is presented below. 



FFY 


Measurable and Rigorous Targets 




Reading 

Participation 


Math 

Participation 


Reading 

Proficiency 


Math 

Proficiency 


AYP 

Rates 


Baseline 2004 


99.4% 


99.6% 


56.6% 


51.1% 


22.7% 


2005 

(2005-2006) 


99.5% 


99.5% 


57.0% 


51.5% 


23.0% 


2006 

(2006-2007) 


99.5% 


99.5% 


57.5% 


52.0 % 


25.0% 


2007 

(2007-2008) 


99.5% 


99.5% 


58.0% 


52.5% 


25.0% 


2008 

(2008-2009) 


100% 


100% 


58.5% 


53.0% 


27.0% 


2009 

(2009-2010) 


100% 


100% 


59.0% 


53.5% 


28.0% 


2010 

(2010-2011) 


100% 


100% 


59.5% 


54.0% 


29.0% 
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There are a number of reasons why participation is not a 100%, including: 

• Parents deciding to have their children opt out of assessments. 

• Extended absence for some children on lEPs. 

• Inability to finish the reading or math assessments. 

With regard to reading and math assessment scores among students with disabilities, 
there has been a slight increase in reading scores in the past three years, but a decrease 
in math scores. The increase in Reading Scores is largely attributable to numerous 
reading programs that are in place within district and CDE technical assistance and 
trainings offered, such as: 

• Odyssey Program 

• Language Essentials for Teachers of Reading and Spelling (LETRS) 

• Leadership essentials for Adolescents Struggling with Reading Success (LASRS) 

The decrease in Math Scores points to a need for direct activities to address math 
learning for the special education population. 

Baseline and targets were revised in FFY 2006. It has been determined that these 
baseline and targets continue to reflect data for Colorado and will not be revised. 

I improvement Activities/ Timelines/ Resources 



In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


1. Develop a research plan 
to study effective 
reading strategies for 
students with 
disabilities. 


FFY 2006 


Result was development of the 
Rural Secondary Literacy 
Project. (See activity 10). 




c 






2. Examine impact of 
State's Math & Science 
Partnerships on 
Instructional Practices 
and use lessons learned 
to improve math 
instruction. 


FFY 2007 


The CDE cosponsors an annual 
conference, Math on the Planes 
with Colorado Council for 
Learning Disabilities, and the 
International Dyslexia 
Association/Rocky Mountain 
Branch. 




c 







Part B State Performance Plan: 2005-2010 
(OMB NO: 1820-0624 / Expiration Date: 2/29/2012) 



Page 25 of 176 




SPP Template - Part B (3) 



Colorado 



Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


3. Conduct Technical 
Assistance Trainings on 
modifications and 
accommodations within 
grade level curriculum 
content areas. 


FFY 2007 
FFY 2008 


Regional trainings and webinar 
on eligibility and instructional 
accommodations have been 
provided. 

Ongoing technical assistance is 
available through the CDE's 
Unit of Student Assessment and 
the Exceptional Student 
Leadership Unit. 


O 


c 






4. Conduct state-wide 
training on the 
appropriate use of 
accommodations in both 
instruction and 
assessment. 


FFY 2007 
FFY 2008 


Technical assistance has been 
provided regarding students 
with combined hearing and 
vision loss through the 
Colorado Services for Children 
and Youth with Combined 
Vision and Hearing Loss 
Project. 

Modules have been developed 
specific to literacy instruction 
for students with significant 
support needs. 


O 


c 
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Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


C 


R 


D 


5. Publish two types of 
accommodations 
manuals: 

• Colorado 
Accommodations 
manual for students 
with disabilities. 

• Colorado 
Accommodations 
manual for students 
who are English 
Language Learners. 


FFY 2007 
FFY 2008 


Manual can be found on the 
Unit of Student Assessment's 
website 

httD:// www. cde. state, co. us/cde 
assess/documents/csao/ manual 
s/2009/2008- 

0929 CO Accomm Man. pdf. 




c 






The Catalyst Series: 
Accommodations for CSAP was 
produced and posted on the 
CDE website 

http://www.cde.state.co.us/cde 
assess/documents/csao/Catalvs 
t/Catalvst Series Accommodati 


ons Oct 08.pdf. 

DVD addressing Standard and 
ELL Accommodations for CSAP 
was produced and 
disseminated. 

Colorado is one of a few of 
states that has a 
comprehensive system for 
review of its Braille and large 
print tests. 


6. An Eligibility packet that 
informs 1 EP team 
decision making 
regarding eligibility for 
the state alternate 
assessment (CSAPA) 
was developed and 
released. 


FFY 2008 


An eligibility packet was 
updated to include a revised 
definition of "significant 
cognitive disability" per the 
federal review requirements of 
the CSAPA test. This can be 
found at: 

http://www.cde.state.co.us/cde 
sped/ Eliaibilitv. asp. 

Training on the eligibility packet 
was provided. 




c 







Part B State Performance Plan: 2005-2010 
(OMB NO: 1820-0624 / Expiration Date: 2/29/2012) 



Page 27 of 176 



SPP Template - Part B (3) 



Colorado 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


7. Provide regional training 
on accommodations, 
adaptations, and 
eligibility for the state 
alternate system. 


FFY 2007 
FFY 2008 


Regional trainings for District 
Assessment Coordinators 
(DACs), Special Education 
Directors and other personnel 
on CSAPA and CELA 
administration were provided. 
1 nformation about 
accommodations, adaptations 
and eligibility for state 
assessments was included. 




c 






8. Revise the 

accommodations manual 
to reflect stakeholder 
feedback on the 
utilitarian nature of the 
document. 


FFY 2007 
FFY 2008 


ESLU solicited and received 
public input to inform the 
revision. 

The CDE determined this to be 
an ongoing administrative task 
rather than an improvement 
activity targeted at improving 
results so it is being deleted. 




c 




D 



Part B State Performance Plan: 2005-2010 
(OMB NO: 1820-0624 / Expiration Date: 2/29/2012) 



Page 28 of 176 





SPP Template - Part B (3) 



Colorado 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 










o= 


Ongoing 


f 








C= Complete; 








R= 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


9. Support and expand 


FFY 2008 


Offered 3-semester course on 




c 






trainings on reading 




Teaching Reading and Writing: 










instruction. 


FFY 2008 


An Introduction for Teachers 
of Students who are 
Blind/Visually Impaired. 














The CDE provided updated 
training for the state cadre of 
LETRS (Language Essentials for 
Teachers of Reading and 
Spelling) trainers. The cadre 
has provided regional training 
and continues to be available. 


O 












The CDE continues to support 
the Odyssey Project to provide 
literacy training. The topic for 
2007 was literacy. 














Interventions and Progress 
Monitoring; oral language and 
vocabulary development are 
the planned foci for the 2008 
Odyssey Project. 










10. The Rural Secondary 


FFY 2007 


The Rural Secondary Literacy 


0 








Literacy Project is a CDE 


FFY 2008 


Project (RSLP) is a three- year 










cross- unit project 


collaborative initiative among 










focusing on improving 




the CDE's Exceptional Student 










literacy among all 




Leadership Unit, Literacy 










students in select rural 




Grants and Initiatives (LGI) 










districts. 




Unit, and Regional Services. It 
has provided training and 
coaching support for 21 rural 
school districts implementing 
literacy initiatives at the 
secondary level. 
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Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


11. Develop program to 
address math 
instruction. 


FFY 2007 
FFY 2008 
FFY 2009 


In collaboration with the Office 
of Teaching and Learning, the 
CDE supports several 
conferences and training during 
the year related to math 
instruction and performance of 
students with disabilities. 


O 








12. 1 nitiated work to include 
Special Education 
general supervision 
results in the 
accreditation process of 
school districts. 


FFY 2007 
FFY 2008 


Discussion with other CDE Units 
on how to incorporate special 
education monitoring with 
accreditation process. 

ESLU staff participate in 
reviews regarding struggling 
districts and provide data and 
support to improve student 
performance. 


O 








13. Expand training about 
instructional strategies 
related to Rtl . 


FFY 2007 


A video about Response to 
Intervention (Rtl) was created 
by the CDE giving an overview 
of the six essential components 
(leadership, problem 
solving/consultation process, 
curriculum and instruction, 
school climate and culture, 
family and community 
engagement). A copy was 
distributed to every 
superintendent in the state. 

A guidebook for Rtl 
implementation was developed. 
A copy of this guide can be 
found on the website at: 
httD:// www.cde.state.co. us/ rti / 
ToolsResourcesRtl .htm. 




c 

c 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


13. (continued from above) 
Expand training about 
instructional strategies 
related to Rtl . 


FFY 2007 


A Leadership module 
addressing the six essential 
components of Rtl was 
developed and 8 regional 
trainings provided. Over 1,100 
administrators were trained. 
Problem Solving/ Consultation, 
Assessment/ Progress 
Monitoring, and Family and 
Community Engagement were 
two consistently identified 
areas of need. These modules 
were developed for 2008. 




c 










A statewide taskforce met to 
develop guidelines for the 
identification of Specific 
Learning Disabilities (SLD) that 
incorporates an Rtl framework 
for developing of body of 
evidence used for eligibility 
determination 

httD:// www. cde. state, co. us/cde 
soed/download/odf/SLD Guidel 
ines.Ddf. 




c 







Resources Used to Support Activities 

• The CDE Unit of Student Assessment 

• ESLU I ndicator 3 team 

• ESLU Significant Support Needs team 

• Rtl team 

• Colorado Deafblind Advisory Committee 

• Vision Coalition 
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Revisions for FFY 2008 

The CDE is revising and/or adding improvement activities to better reflect current practices. 
Improvement activities are being added to continue through FFY 2010. 



Revised I mprovement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. Develop tool kit for the 
new alternate 
achievement standards. 


Develop the tool kit. 

Provide training/support on 
the new alternate 
achievement standards to 
teachers whose students with 
significant cognitive support 
needs take alternate 
assessments. 


FFY 2010 


ESLU Low 
Incidence 
Support Team 


2. Develop teaching guide 
and training related to 
accommodations and 
modifications aligned to 
the new Colorado Model 
Content Standards. 


htto:// www. cde. state, co. us/c 
deassess/UAS/CoAcademicSt 
andards.FItml. 

Develop learning 
progressions. 

Provide training on the use of 
learning progressions. 


FFY 2009 
FFY 2010 


ESLU Student 

Achievement 

Consultant 

Contractors 


3. Statewide Assistive 

Technology Augmentative, 
Alternative, 

Communication (SWAAAC) 
Summer Symposium 
Using Assistive Technology 
for Assessment. 


SWAAAC Symposium 
provides training on selecting 
and implementing assistive 
technology for instruction and 
assessment. 


FFY 2009 


Assistive 

Technology 

Partners 


4. Low Vision Evaluation 
Clinics. 


Provide regional low vision 
evaluation clinics to school 
age children with low vision 
to determine the need of 
magnification tools as 
instructional and assessment 
accommodations. 


FFY 2009 
FFY 2010 


ESLU Low 
Incidence 
Support Team 


5. Cochlear Implants Video 
Conference. 


Provide training for teachers 
on improving instructional 
practices for students with 
Cochlear 1 mplants. 


FFY 2009 


ESLU Low 
1 ncidence 
Support Team 
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Activity 


Action Steps 


Timeline 


Resources 


6. Deaf/Hard of Hearing 
Statewide Trainings. 


Provide training for teachers 
on using the communication 
plan and improving 
instructional practices for 
students who are Deaf/Hard 
of Hearing. 


FFY 2008 
FFY 2009 


ESLU Low 
1 ncidence 
Support Team 
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Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: FAPE in the LRE 



I ndicator 4: Rates of suspension and expulsion: 

A. Percent of districts identified by the State as having a significant discrepancy in the 
rates of suspensions and expulsions of children with disabilities for greater than 10 
days in a school year; and 

B. Percent of districts identified by the State as having a significant discrepancy in the 
rates of suspensions and expulsions of greater than 10 days in a school year of 
children with disabilities by race and ethnicity. 

~ Note: Component B Currently Not Required Due to Possible Constitutionality 

Concerns- 

(20 U.S.C. 1416(a)(3)(A); 1412(a)22)) 



Measurement: 

A. Percent = # of districts identified by the State as having significant discrepancies in the 
rates of suspensions and expulsions of children with disabilities for greater than 10 days 
in a school year divided by # of districts in the State times 100. 

B. Percent = # of districts identified by the State as having significant discrepancies in the 
rates of suspensions and expulsions for greater than 10 days in a school year of children 
with disabilities by race/ ethnicity divided by # of districts in the State times 100. 

Include State's definition of "significant discrepancy." 



Overview of Issue/ Description of System or Process 

COMPONENT A 

The collection of accurate and consistent data on suspensions and expulsions is a 
challenge in Colorado. A variety of stakeholder groups as well as special education 
directors have communicated that there is tremendous variability with regard to 
classification and reporting of discipline data across administrative units and across time. 
Currently, the CDE compares suspension/expulsion of individual administrative units to 
the statewide average. Significant discrepancy is defined as two standard deviations 
above the state average. Colorado uses 618 data reported in Table 5, Section A, 
Columns 3A, 3B, and 3C to calculate suspension/expulsion rates for students with 
disabilities. The statewide rate is 12 students for every 1,000 students. 

Given the challenges surrounding the issue of consistent reporting of 
suspension/expulsion, the CDE is considering development of a new definition of 
significant discrepancy as part of its efforts to address data collection and reporting for 
Part B of this indicator. One option being considered is using a comparison between 
rates for general and special education students within each administrative unit. 

Our system for follow-up if a discrepancy occurs has been limited (see discussion of 
baseline data under Indicator 15) because of resource constraints that exist within the 
CIMP process and because of the inconsistency and instability of the discipline data. The 
CDE has recently convened a task force to address shortcomings both in discipline data 
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integrity as well as follow-up procedures when discrepancies emerge. The task force is 
committed to ensuring that when discrepancies occur, the State education agency 
reviews and, if appropriate, revises (or required the affected State or local educational 
agency to revise) its policies, procedures, and practices relating to the development and 
implementation of I EPs, the use of positive behavioral interventions and supports, and 
procedural safeguards, to ensure that such policies, procedures, and practices comply 
with the requirement of this indicator. 

February 2007 Update and Measurement Clarification : During FY2005, the CDE refined 
its process for flagging and monitoring AU Suspension/Expulsion data for the purpose of 
driving improvement on this component of the indicator. The definition of "significant 
discrepancy" continues to be two standard deviations above the mean of all AU rates. 
The improvement targets are designed such that a monitored AU's rate is always 
compared to a cut-off using the statewide mean rate and standard deviation for the year 
during which the AU was flagged. In order to meet the improvement targets, during 
each subsequent year, an AU's current rate is expected to reflect a 0.2 standard 
deviation drop using the statewide mean rate and standard deviation from the year that 
the AU was flagged . The CDE continues to monitor the suspension/expulsion for all AUs 
flagged in a given year until it is within one standard deviation of the mean for the year 
that it was collected, at which time the flag is cleared. If a flagged AU's rate does not 
meet its improvement targets for two years in a row, this will trigger a drill-down on 
policies and procedures related to suspension/expulsion and may lead to the AU being 
entered into the Continuous Improvement Monitoring Process. 

February 2008 Update: OSEP's FFY2005 SPP/APR indicated strongly recommended that 
Colorado revise its targets because as originally written, they reference AUs that have 
already been identified as significantly discrepant. Colorado has updated its targets to 
reflect the percentage of districts identified by the State as having a significant 
discrepancy in rates of suspensions and expulsions of children with disabilities for 
greater than 10 days in a school year. However, Colorado stakeholders feel that there 
are always going to be at least one or two AUs with relatively high long-term discipline 
actions among students with disabilities for valid reasons that are not grounded in 
inappropriate policies, procedures and practices. Colorado's baseline data for Indicator 
4a is 7.1% (N=4). Given the feeling that an improvement target of 0% is unrealistic, 
Colorado has set rather minimal improvement targets over baseline over the life of the 
SPP. 

Additionally, Colorado has decided in FFY2006 to revise its definition of "significant 
discrepancy" so that it does not involve use of standard deviation among long-term 
discipline rates per 100 students. This was used in the original definition because it 
formed the basis of the improvement targets. Since standard deviations are no longer 
used in the targets, Colorado prefers using a definition that is less sensitive to the 
impact of outliers in the definition since the distribution of long-term discipline rates 
among AUs varies widely. Beginning with FFY2006, Colorado will define "significant 
discrepancy" as a rate that is over 6 times the median rate among Colorado's 56 AUs. 
For FFY2006, the distribution of long-term discipline rates per 100 students among 
Colorado's 56 AUs had the following properties: 

• Range: 0 to 36.9 

• Mean: 1.45 

• Median: 0.52 

• Standard Deviation: 4.89 
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For FFY2006, The old definition would have set a more lenient cut-point of 9.78 long- 
term suspension and expulsions per 100 students while the new definition results in a 
cut-point of 3.12 students per 100 students. For FFY2006, either definition would result 
in 1 AU determined to have significant discrepancy in rates of long-term suspension and 
expulsions for students with disabilities. 



COMPONENT B 

February 2007 Update: Most Administrative Units in Colorado report relatively few 

suspensions/expulsions among students with disabilities for greater than 10 days 
regardless of race/ ethnicity. In FY2005, 17 of the 57 AUs reported long-term 

suspensions/expulsions for more than 10 students with disabilities (SWD) and only 8 
AUs reported long-term suspensions/ expulsions for more than 20 SWD. Examining the 
minority population only, 9 AUs reported long-term suspensions/expulsions for more 
than 10 SWD and 5 AUs reported long-term suspensions/expulsions for more than 20 
SWD. When the minority population is broken out by specific race/ ethnicity, the 
individual cell size for long-term suspension/expulsions is quite small for most AUs. 

Therefore, significant discrepancy is calculated by using the total minority population 
within AUs rather than breaking out the calculation for individual races/ ethnicities. 
Specifically, the calculation involves, for each AU, determining the percent of SWD that 
had long-term suspensions/expulsions who are in the minority population (A). This 
percentage is then compared to the percent of all SWD that are in the minority 
population (B). If A exceeds B by more that 20%, then the AU is flagged for having 
significant discrepancies in the rates of suspensions and expulsions for greater than 10 
days in a school year of children with disabilities by race/ ethnicity. Flowever, the 
minimum cell size for the discrepancy calculation to be performed for any AU is at least 
10 SWD with long-term suspension/expulsions, regardless of race/ ethnicity. 



Baseline Data for FFY 2004( Component A) and FFY2005 (Component B) 

A. 7.1% (N=4) of the Districts in Colorado had suspension rates of greater six time the 
median rates for all AUs in the State. 

B. 3.5% (N=2) of the Administrative Units were identified by the State as having 
significant discrepancies in the rates of suspensions and expulsions for greater than 
10 days in a school year of children with disabilities by race/ ethnicity. 

Discussion of Baseline Data 

Given the challenges with reliability and validity of suspension/expulsion data, examining 
multi-year trends is not fruitful as changes in the trends can reflect changes in 
categorization and reporting strategies rather than actual discipline practices in the field. 
Although data is already reported by ethnicity, as needed by Part B of this indicator, the 
calculation of significant discrepancy on this new part will need to be defined using 
stakeholder input. As part of this process, the calculation of significant discrepancy for 
Part A will also be examined and will more than likely change. All new calculations, 
baseline data and revised targets will be submitted with the FFY 2005 APR due February 
1, 2007. 

February 2007 Update: See FY2005 APR for a discussion on how the CDE will work to 
address year-to-year fluctuations in long-term suspension/expulsion data submitted by 
AUs. 



Part B State Performance Plan: 2005-2010 
(OMB NO: 1820-0624 / Expiration Date: 2/29/2012) 



Page 36 of 176 







SPP Template - Part B (3) 



Colorado 



COMPONENT B 

February 2007 : In FY2005, 17 of the 57 AUs reported long-term suspensions/ expulsions 
for more than 10 students with disabilities (SWD), regardless of race. The "significant 
discrepancy" for these 17 AUs is shown in the table below. The differences that are 
highlighted in yellow are considered "significantly discrepant" 



AU 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 
11 
12 

13 

14 

15 

16 
17 



SPED 
POP. (N) 



3480 

760 

3656 

509 

5216 

1787 

2016 

9337 

4187 

2884 

437 

8989 

2567 

1803 

2632 

2013 

2117 



... .. Total 

p M o n p° r ,'Si 



1318 

465 

2530 

178 

1741 

339 

599 

7329 

620 

1026 

191 

2382 

647 

356 

554 

1301 

1151 



19 

30 
11 

13 
62 

14 
16 

163 

15 
26 
19 
74 
13 
36 
36 

16 

31 



% SPED 
Minority 
(B) 

0.378736 

0.611842 

0.692013 

0.349705 

0.333781 

0.189703 

0.297123 

0.784942 

0.148077 

0.355756 

0.437071 

0.264991 

0.252045 

0.197449 

0.210486 

0.646299 

0.543694 



% LT 
Susp/ Exp 
Minority 
(A) 

0.631579 

0.766667 

0.727273 

0.230769 

0.419355 

0.5 

0.375 

0.858896 

0.333333 

0.461538 

0.263158 

0.364865 

0.384615 

0.305556 

0.388889 

0.5625 

0.677419 



Difference 

(A-B) 



0.25 

0.15 

0.04 

( 0 . 12 ) 

0.09 

0.31 

0.08 

0.07 

0.19 

0.11 

( 0 . 17 ) 

0.10 

0.13 

0.11 

0.18 

( 0 . 08 ) 

0.13 
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FFY 


Measurable and Rigorous Target 
(Revised February 2008) 

A 


Measurable and Rigorous Target 
B 


2005 

(2005-2006) 


6% 




2006 

(2006-2007) 


5% 




2007 

(2007-2008) 


5% 




2008 

(2008-2009) 


4% 




2009 

(2009-2010) 


4% 




2010 

(2010-2011) 


4% 
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I mprovement Activities/ Timelines/ Resources 



In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


C 


R 


D 


1. Within the general 
supervision process, 
identify AUs with 
significant discrepancies 
in either component of 
this indicator and require 
these agencies to 
examine the data and to 
identify proactive 
initiatives to reduce 
discrepant rates. 


Fall 2005 


The CDE determined this to be 
an ongoing administrative task 
rather than an improvement 
activity targeted at improving 
results so it is being deleted. 








D 


2. Develop and implement 
Technical Assistance to 
improve data collection 
and reporting procedures 
across all AUs. 


FFY 2007 


Training about reporting 
suspension/ expulsion data to 
the CDE has been provided to 
all Alls during EOY data 
trainings across the state. 




c 






3. Convene stakeholder 
meeting to develop new 
criteria for defining 
significant discrepancy of 
suspension and 
expulsion rates. 


FFY 2006 


"Significant discrepancy" 
defined in the FFY 2006 APR. 




c 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 










o= 


Ongoing 


f 








C= Complete; 








R= 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


4. Convene a task force to 


Winter 


This task force led to the 




c 






discuss data concerns, 


2006 


creation of the 1 ndicator 4 










integrity and follow up. 




team. 














The Indicator 4 team developed 
a tool to guide review of 
policies, procedures and 
practices. 














The team created a Technical 
Assistance document that 
aligns with best practices and 
the activities and goals of the 
Mental Health Team and 
Colorado School-wide Positive 
Behavior Supports Initiative. 










5. Provide training for 


FFY 2006 


CDE staff from several units 


O 








School Safety and 


FFY 2007 


provides technical assistance to 










Prevention staff 


school districts throughout the 










regarding parent 


FFY 2008 


year. 










engagement, school 
attachment, and 


FFY 2009 












interventions for alcohol, 
drug dependency and 
tobacco use. 


FFY 2010 












6. Provide training provided 


FFY 2006 


Topics related to the use of 




c 






for School Social 


FFY 2007 


Positive Behavior Support 










Workers, School 


strategies and interventions 










Psychologists and other 


FFY 2008 


were integrated into statewide 










educators in positive 
behavioral supports. 




conferences. 










7. Develop a new Behavior 


FFY 2006 


Training in completing the form 




c 






Intervention Plan (BIP) 


Final 

approval 

1/6/08 


was conducted in October 










form to align with the 
state recommended IEP 
forms. 


2007. 











Part B State Performance Plan: 2005-2010 
(OMB NO: 1820-0624 / Expiration Date: 2/29/2012) 



Page 40 of 176 






SPP Template - Part B (3) 



Colorado 



Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


8. Training of non-PBS 
school districts on 
behavior, mental health 
issues, use of positive 
behavioral interventions 
and supports for 
students with the most 
significant challenges. 


FFY 2007 


Trainings were offered 3 times 
each school year in regions 
across the state. 

Topics include: 

• functional behavioral 
assessments; 

• strategies for working with 
students with mental health 
needs; 

• collaborating with community 
partners. 




c 






9. The CDE will determine 


FFY 2007 


Data are available annually 


O 








the out of school 


FFY 


using 618 data. This 










suspensions (OSS) data 


r r T z uuo 


information is reviewed for 










trends for children with 


FFY 2009 


each AU in the state to identify 










disabilities in PBS 


FFY 901 H 


trends for students with 










schools. 


rrl ZU1U 


disabilities. 










10. The CDE will continue to 


FFY 2006 


PBS regional technical 


O 








provide training to 


FFY 2007 


assistance model has provided 










improve data collecting 




opportunities to increase 










and reporting procedures 


FFY 2008 


proficiency in the data 










across all AUs. 


ffy onna 


collection, analysis and 












r r I z uuy 


reporting of Office Disciplinary 














Referrals. 










11. Technical assistance for 


FFY 2006 


PBS is providing technical 




c 






establishing positive, 


FFY 2007 


assistance and training to 62 of 










proactive, and 




178 school districts in the State 










preventative learning 


FFY 2008 


of Colorado. 










environments is provided 














to 35% of all Colorado 














school districts— those 














involved in the PBS 














initiative. 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 










o= 


Ongoing 


f 








C= Complete; 








R= 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


12. PBS trainings will 


FFY 2007 


The CDE is providing training 


O 








directly address 


FFY 2008 


regarding minimizing problem 










alternatives to 


behaviors in schools and 










suspension as well as 


FFY 2009 


classrooms as well as 










continue training on 


FFY 2010 


disciplinary alternatives to 










preventative strategies 
for minimizing problem 
behaviors. In addition, 
function- based support 
is a training topic for 
newly implementing 
districts. 


suspensions. 
















13. 1 n collaboration with the 


FFY 2007 


This has occurred at multiple 




c 






Rtl initiative, the 


FFY 2008 


conferences as well as directs 










problem-solving model 


technical assistance in multiple 










will be taught to districts 
implementing PBS. 




regions of the State. 










14. Support current districts 


FFY 2008 


Develop a technical assistance 


0 








full-scale implementation 


FFY 2009 


tool called "Partnership for 










of Positive Behavioral 


Success" describing phases of 










Supports. 


FFY 2010 


implementation for PBS 
districts. 














Provide training and TA to 
interested Alls on "Partnership 
for Success" documents 
annually. 










15. Identify and provide 


FFY 2008 


Training provided through a 


0 








training and technical 


FFY 2009 


variety of state conferences, 










assistance regarding 


Blackboard trainings, and 










research- based 


FFY 2010 


regional technical assistance 










approaches to improve 
school climate and 
culture. 




coordinators. 
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Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


16. Provide guidance 

through on-line trainings 
and technical assistance 
regarding research- 
based approaches to 
reduce discipline issues 
for students with 
disabilities. 


FFY 2008 
FFY 2009 
FFY 2010 


Multiple units at CDE (ESLU, 
Rtl/PBS, Prevention Initiatives) 
will provide on-line trainings. 


O 








17. Provide information to 
school personnel 
regarding bully- 
prevention research. 


FFY 2008 


Information continues to be 
provided as it is updated and as 
new research becomes 
available. 


O 








18. Develop a technical 
assistance tool 
identifying best practices 
that can be pinpointed to 
district specific areas of 
concern based on 618 
data. 


FFY 2008 
FFY 2009 


Indicator 4 Self-Assessment 
Tool, Technical Assistance 
Probes and related tools were 
developed and are available at: 

htto: // www. cde. state, co. us/cde 
soed/SPP TraininaMaterials.aso 

The tools continue to be 
updated as needed. 


0 









Resources Used to Support Activities 

• Training Calendars 

• I ndicator 4 Team 

• CDE Prevention Initiatives Unit 

• CDE Rtl Team 

• CDE Behavior Leadership/PBS Team 

• Indicator 4 review documents 
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Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: FAPE in the LRE 



For FFY 2008 the measurement for Indicator 5 was changed. The Indicator now reads: 
I ndicator 5: Percent of children with I EPs aged 6 through 21 served: 

A. I nside the regular class 80% or more of the day; 

B. I nside the regular class less than 40% of the day; and 

C. In separate schools, residential facilities, or homebound/hospital placements. 

(20 U.S.C. 1416(a)(3)(A)) 



Measurement: 

A. Percent = [(# of children with I EPs served inside the regular class 80% or more of 

the day) divided by the (total # of students aged 6 through 21 with I EPs)] times 

100 . 

B. Percent = [(# of children with I EPs served inside the regular class less than 40% of 

the day) divided by the (total # of students aged 6 through 21 with I EPs)] times 

100 . 

C. Percent = [(# of children with lEPs served in separate schools, residential facilities, 
or homebound/hospital placements) divided by the (total # of students aged 6 
through 21 with I EPs)] times 100. 



Overview of Issue/ Description of System or Process 

Colorado used the 618 data reported to OSEP on 12/1/04 to calculate the percentage of 
children in each of the sub-groups noted above. 

Baseline Data for FFY 2004 (2004-2005) 

A. Served in regular class 80% of more of the day 

B. Served in regular class less than 40% of the day 

C. Served in separate schools, residential placement or home/hospital 

Discussion of Baseline Data 

As shown Table 2, Colorado's placement strategies result in LRE data that substantially 
exceed national averages. More than two-thirds of students with disabilities are served 
in the general education classroom for most of the day. However, other options are 
clearly available and utilized as needed and as appropriate. Three year trend data is 
shown in Figure 5, and indicates a relatively high level of stability over time. Given that 
the baseline data is already quite positive, only minimal resources will be expended on 
improving this indicator and programs targeting this indicator as a whole are not 
expected to improve percentages dramatically. Therefore, the targets were set 
accordingly. 



70.3% 

7.8% 

4.2% 
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Figure 5. Three year trend data for LRE. 



c 

CD 

2 

CD 

CL 



80 

70 

60 

50 

40 

30 

20 

10 

0 



69.2 



70 



70.3 



9.2 



-4x4- 



7.6 



4JL 



7.8 



4x2- 



2002 



2003 



2004 



□ >80% 

□ <40% 

■ Separate 



Year 



Table 2. Comparison of Colorado LRE with National LRE. 



Placement outside the regular classroom % of CO 

population 

A. >80% 70.3% 

B. >40% 7.8% 

C. Separate facilities 4.2% 



*Data taken from the USDOE/OSERS website 



% of US 
population* 

50.0 

19.0 



3.1 



FFY 


Measurable and Rigorous Target 




Measurement A 
>80% 


Measurement B 
<40% 


Measurement C 
Separate 


2005 

(2005-2006) 


70.3% 


7.8% 


4.2% 


2006 

(2006-2007) 


70.5% 


7.7% 


4.1% 
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FFY 


Measurable and Rigorous Target 




Measurement A 
>80% 


Measurement B 
<40% 


Measurement C 
Separate 


2007 

(2007-2008) 


70.7% 


7.6% 


4.0% 


2008 

(2008-2009) 


70.9% 


7.5% 


3.9% 


2009 

(2009-2010) 


71.1% 


7.4% 


3.8% 


2010 

(2010-2011) 


71.3% 


7.3% 


3.7% 



Baseline data were reported for FFY 2004 and was used to set targets. While the 
measurement has changed it was a language change and not a data change. Therefore, 
baseline and targets are not being re-set at this time. 



I improvement Activities/ Timelines/ Resources 



In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


1. 1 dentify administrative 
units with excessive 
numbers of restrictive 
placements. 


FFY 2006 
FFY 2007 
FFY 2008 


The CDE determined this to be 
an ongoing administrative task 
rather than an improvement 
activity targeted at improving 
results so it is being deleted. 








D 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


2. Continue training and 
supervision of LRE 
reporting. 


FFY 2006 
FFY 2007 


Training was part of Student 
618 data collection training 
where every AU in the state 
was trained. 




c 










Technical assistance is ongoing. 










3. Expand the Positive 
Behavioral Supports 
program. 


FFY 2006 
FFY 2007 


Data are not available to 
provide a connection between 
Positive Behavioral Supports 
and placement. 








D 


4. Modify the Cl MP system 
to require AUs with high 
numbers of restrictive 
placements to 
investigate placement 
procedures and 
additional options. 


FFY 2008 


The CDE determined this to be 
an ongoing administrative task 
rather than an improvement 
activity targeted at improving 
results so it is being deleted. 








D 


5. Support AUs that have 
excessive numbers of 
restrictive placements to 
develop improvement 
strategies. 


FFY 2008 
FFY 2009 
FFY 2010 


Drill down procedures were 
used to identify and provide 
specific technical assistance 
necessary. 


O 








6. Formation of 1 ndicator 5 
team. 


FFY 2007 
FFY 2008 
FFY 2009 


The Indicator 5 Team was 
formed for the purpose of 
analyzing data and provided 
technical assistance. 


O 










FFY 2010 


The team will develop 
procedures for AUs to use to 
examine their policies, 
procedures and practices 
related to how placement 
decisions are made. 














The team will disaggregate data 
to determine if there is a 
correlation between placement 
and disability category. 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


7. Follow up with AUs that 
are outliers in placement 
data to determine cause. 


FFY 2008 
FFY 2009 
FFY 2010 


AUs that are outliers were 
identified. Such AUs examine 
policies, procedures and 
practices to determine how 
placement decisions are made. 


O 








8. Form Rtl 

1 mplementation Team. 


FFY 2006 
FFY 2007 


Team comprised of a variety of 
stakeholders across the state 
(e.g., Superintendents, 
Principals, teachers, parents). 




c 






9. Provide professional 
development of essential 
components of Rtl . 


FFY 2007 
FFY 2008 


Trainings in the essentials of 
Rtl were conducted across the 
state to a variety of audiences. 




c 







Resources Used to Support Activities 

• CDE Rtl/PBS Unit 

• ESLU General Supervision team 

• ESLU I ndicator 5 team 

• CDE Data Services Unit 

Revisions for FFY 2008 

The CDE is revising and/or adding improvement activities to better reflect current practices. 
Improvement activities are being added to continue through FFY 2010. 

Revised I mprovement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. Professional Development 
activities to include: 

a. Learner Outcomes and 
1 nclusive Practices. 

b. Settings vs. Services. 

c. Differentiation. 


Development of the trainings 
in several formats (e.g., 
Trainer of Trainers modules, 
webinars, or Blackboard 
online courses). 


FFY 2009 
FFY 2010 


ESLU Low 
1 ncidence 
Support Team 
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Activity 


Action Steps 


Timeline 


Resources 


2. Colorado Autism and 
Significant Support Needs 
Model Programs Project. 


Four elementary programs 
were developed in FFY 2009. 

Four preschool and/or 
secondary level programs will 
be added. 


FFY 2009 
FFY 2010 


ESLU Low 
1 ncidence 
Support Team 

CDE Rtl/PBS 
Unit 


3. Development of Quality 
1 ndicators with a 
component on inclusive 
practices (Autism and SSN 
populations). 


Provide copies of the Quality 
1 ndicators to AUs. 

Statewide trainings. 


FFY 2009 


ESLU Low 
1 ncidence 
Support Team 


4. Professional Development 
on the use of 
Accommodations and 
Modifications for 
instruction. 


Statewide trainings 
conducted on a regional 
basis. 


FFY 2009 
FFY 2010 


ESLU Low 
Incidence 
Support Team 


5. Professional Development 
on the Rtl process for 
students with Low 
Incidence Disabilities. 


Develop products (e.g., Fast 
Facts) about implementing 
the Rtl process for students 
with low incidence 
disabilities. 

Provide training for AUs who 
are not using the Rtl process 
for students with low 
incidence disabilities. 


FFY 2009 
FFY 2010 


ESLU Low 
Incidence 
Support Team 

CDE Rtl/PBS 
Unit 


6. Math Instruction for 
Students with Disabilities 
including specialized 
instruction and adaptive 
materials. 


Provide statewide training for 
teachers of students with 
visual impairments on 
specialized math instruction 
and the use of adaptive 
materials. 

Rtl Math Module training to 
improve performance of 
students with disabilities. 


FFY 2010 


ESLU Low 
Incidence 
Support Team 

CDE Rtl/PBS 
Unit 
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Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: FAPE in the LRE 



Indicator 6: Percent of preschool children with lEPs who received special education and 
related services in settings with typically developing peers (e.g., early childhood settings, 
home, and part-time early childhood/part-time early childhood special education settings). 

(20 U.S.C. 1416(a)(3)(A)) 



Measurement: 

Percent = # of preschool children with lEPs who received all special education services in 
settings with typically developing peers divided by the total # of preschool children with 
I EPs times 100. 



Overview of Issue/ Description of System or Process 

Colorado is a national leader in inclusion practices for children with disabilities of all ages 
with rates of services provided in the context of the general classroom placing the state 
well above national averages. Since the inception of the preschool special education 
mandate, the primary model for providing FAPE, including access to the general 
curriculum, and LRE for young children with disabilities in Colorado has been a blended 
preschool classroom approach -- braiding funds from special education, the Colorado 
Preschool Program (CPP), Title I, Head Start and private pay tuition. These blended 
classrooms may be established and supervised on public school property or as 
partnerships with private or Head Start Programs. Some sites place or maintain 
placement of preschoolers with disabilities in community settings on a child by child 
basis. 

The Colorado Quality Standards for Early Care and Education Programs provide guidance 
that general education preschool classrooms or groups should include no more than 3 
children with disabilities in a maximum class size of 15. Historically, this ratio of 3 to 12 
has been difficult to maintain. While acknowledging that this represents preferred 
practice, a goal of 5 children with disabilities to 10 typically developing children in a 
group or classroom has been the target "rule-of-thumb" for classroom ratios. 

In past years, placement setting definitions focused on "who" the setting is designed for, 
coding differently for settings that are "Integrated Early Childhood Settings" and "Early 
Childhood Special Education Settings". This has led to confusion in selecting the 
appropriate code when lEPs are developed. For example, providers were inclined to 
select the latter category (Early Childhood Special Education Setting) because Colorado 
preschool classrooms were initially formed to serve children with disabilities AND they 
are frequently staffed by early childhood special education teachers as lead teachers. 
However, in this example, 2/3 or more of the children may be typical peers and, in 
Colorado, early childhood special educators are also qualified as general early childhood 
educators. 

There is anecdotal evidence that preschool program proportions may be moving toward 
a 50/50 ratio of children with disabilities to those who are typically developing. This is 
attributed to rapid population growth and limited classroom space availability. Because 
of the high value Colorado places on inclusion, the research on the efficacy of inclusive 



Part B State Performance Plan: 2005-2010 
(OMB NO: 1820-0624 / Expiration Date: 2/29/2012) 



Page 50 of 176 






SPP Template - Part B (3) 



Colorado 



preschool programming as well as concerns with recent appellate court rulings on what 
constitutes preschool LRE (see L.B. v. Nebo School District (Nebo) 
www.kscourts.orq/cal0/cases/2004/08/02-4169.htm ), CDE plans to target LRE and 
inclusive practices over the next six years. In addition to the placement discussion, 
emphasis will continue to be placed on the quality of special education and related 
services in the context of general classroom activities and routines. 

February 2007 Update: There is continuing anecdotal evidence in some areas of the 

state that preschool program proportions may be moving toward a 50/50 ratio of 
children with disabilities to those who are typically developing. This is attributed to 
continuing population growth and limited classroom space availability. 

CDE experienced a complete turnover in preschool special education staff between 2005 
and 2006. In addition, during late 2005/early 2006 the training program for preschool 
inclusion with the University of Denver was in transition and not re-started again until 
summer 2006 with the new staff. And in late 2006/early 2007 a new partnership with 
the national Center for the Social Emotional Foundations for Learning was formed which 
adds additional valuable resources to support high quality preschool programs which can 
serve as successful LRE for preschool children with disabilities. 

The CDE early childhood education staff has been working with Colorado's largest district 
to change its inclusion policy. The City and County of Denver voters approved funding 
for a universal preschool option for parents, which will impact the opportunities for all 
children including children with lEPs. Given the size of the county and logistical 
challenges, it not anticipated that this new option will be fully implemented until 
FFY2007. 

Baseline Date for FFY 04 (2004-2005) 

Based on December 1, 2004 count of students by age and federal placement category, 
85% of eligible preschoolers received special education and related services in settings 
with typical peers. (N = 10,307) 

Discussion of Baseline Data 

Based on current placement definitions, 8,665 of the 10,307 eligible preschoolers 
counted in December of 2004 received their special education and related services in 
integrated or combined early childhood setting, with an additional 54 children receiving 
services in the home environment for a total of 8,719 or 85%. 

February 2007 Update: During this past reporting period, there have been substantive 
barriers in Colorado undermining the realization of improvement in of this performance 
indicator. These barriers are primarily attributable to a lack of space while at the same 
time accommodating an increasing number of children being served. Unfortunately, the 
public school/community preschool system does not have the money and personnel to 
increase the number of classrooms needed at this time. 

Given these barriers, coupled with the high recent turnover experienced in preschool 
special education staff, the transition of the training program for preschool education, 
and the timing of implementation of the universal preschool option in community with 
the state's largest district, the CDE early childhood special education staff concluded that 
immediate improvement on this indicator is an unrealistic expectation. Therefore, the 
CDE has proposed a new set of improvement targets that reflect the conclusion that the 
current changes that are occurring in the state will not show an impact in the data until 
FFY2007. The original and revised targets are shown in the following table. The timing 
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of some of the improvement activities has also been adjusted somewhat and the revised 
timeline is presented in a subsequent table. 



FFY 


Measurable and Rigorous Target 
(Original) 


Measurable and Rigorous Target 
(Revised February 2007) 


2005 

(2005-2006) 


86% of percent of preschool 
children with lEPs receive special 
education and related services in 
settings with typically developing 
peers. 


85% of percent of preschool 
children with lEPs receive special 
education and related services in 
settings with typically developing 
peers. 


2006 

(2006-2007) 


87% of percent of preschool 
children with lEPs receive special 
education and related services in 
settings with typically developing 
peers. 


85% of percent of preschool 
children with lEPs receive special 
education and related services in 
settings with typically developing 
peers. 


2007 

(2007-2008) 


88% of percent of preschool 
children with lEPs receive special 
education and related services in 
settings with typically developing 
peers. 


86% of percent of preschool 
children with lEPs receive special 
education and related services in 
settings with typically developing 
peers. 


2008 

(2008-2009) 


89% of percent of preschool 
children with lEPs receive special 
education and related services in 
settings with typically developing 
peers. 


87% of percent of preschool 
children with lEPs receive special 
education and related services in 
settings with typically developing 
peers. 


2009 

(2009-2010) 


90% of percent of preschool 
children with lEPs receive special 
education and related services in 
settings with typically developing 
peers. 


88% of percent of preschool 
children with lEPs receive special 
education and related services in 
settings with typically developing 
peers. 


2010 

(2010-2011) 


91% of percent of preschool 
children with lEPs receive special 
education and related services in 
settings with typically developing 
peers. 


89% of percent of preschool 
children with lEPs receive special 
education and related services in 
settings with typically developing 
peers. 
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I mprovement Activities/ Timelines/ Resources 
(Revised Timelines for Commencement of Items #3 and #4 Only) 



I mprovement Activities Timelines 



Resources 



1. Refine data collection and 
reporting strategies regarding 
the location of special 
education and related services 
provision. Establish baseline 
data and determine rigorous 
targets for improvement. 
Provide training and technical 
assistance to LEAs around data 
collection strategies. 



2005 - 2007 CDE Early Childhood Special 
Education staff 

CDE Fiscal Management Staff 



2. Develop Colorado specific 
subsets for data collection 
around placement setting 
codes and definitions that are 
consistent with new OSEP 
reporting requirements, but 
include additional levels of 
specificity. Provide training 
and technical assistance to 
LEAs around new definitions 
and data collection strategies. 



2005 - 2007 CDE Early Childhood Special 
Education 

CDE Fiscal Management Staff 



3. Provide training and technical 2007 - 
assistance on recommended 
practices and strategies for 
defining and supporting a true 
continuum of placement 
options in early childhood 
programs. 



2010 CDE Early Childhood Special 

Education and Early Childhood staff 

Center for the Social/Emotional 
Foundations of Learning staff 



4. Develop and disseminate tools 2007 - 2010 CDE Early Childhood Special 
and strategies for guiding and Education staff 

documenting LRE decision 
making within the staffing 
process. 
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I mprovement Activities/ Timelines/ Resources 
(Revised Timelines for Commencement of Items #3 and #4 Only) 



I mprovement Activities Timelines Resources 

5. Develop and implement 2006 - 2010 CDE Early Childhood Special 

regional training for LEA staff Education and Early Childhood staff 

on preschool inclusion. ... _ .... . 

r University of Denver National 

Preschool Inclusion Program trained 

team 

Center for the Social/Emotional 
Foundations of Learning staff 

CDE training cadre 
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Part B State Performance Plan (SPP) for 2005-2010 

Overview of the State Performance Plan (SPP) Development 

FFY 2008 is the first year that states are required to present baseline data for Indicator 7. 
Using this baseline data, states are required to establish rigorous targets for FFY 2009 and 
FFY 2010. To help set targets, the CDE convened a stakeholder group that included Special 
Education Directors and Preschool Directors, as well as representatives from Head Start, 
Part C, the CDE Early Childhood and Special Education staffs, PEAK Parent Center 
(Colorado's Parent Training Information Center) and other partners. Additional participants 
in the group included representatives from a quality rating program, parents of students in 
programs, and those with expertise in research, policy, and professional development. 

The stakeholder group was charged with two tasks: 

• Consider baseline data from the assessment methods 

• Assist in determining appropriate targets for Indicator 7 and for each summary 
statement 



Monitoring Priority: FAPE in the LRE 

I ndicator 7: Percent of preschool children aged 3 through 5 with I EPs who demonstrate 
improved: 

A. Positive social-emotional skills (including social relationships); 

B. Acquisition and use of knowledge and skills (including early language/ 
communication and early literacy); and 

C. Use of appropriate behaviors to meet their needs. 

(20 U.S.C. 1416 (a)(3)(A)) 



Measurement: 

Outcomes: 

A. Positive social-emotional skills (including social relationships); 

B. Acquisition and use of knowledge and skills (including early language/communication 
and early literacy); and 

C. Use of appropriate behaviors to meet their needs. 

Progress categories for A, B and C: 

a. Percent of preschool children who did not improve functioning = [(# of preschool 
children who did not improve functioning) divided by (# of preschool children with 
I EPs assessed)] times 100. 

b. Percent of preschool children who improved functioning but not sufficient to move 
nearer to functioning comparable to same-aged peers = [(# of preschool children 
who improved functioning but not sufficient to move nearer to functioning 
comparable to same-aged peers) divided by (# of preschool children with I EPs 
assessed)] times 100. 
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c. Percent of preschool children who improved functioning to a level nearer to same- 
aged peers but did not reach it = [(# of preschool children who improved functioning 
to a level nearer to same-aged peers but did not reach it) divided by (# of preschool 
children with I EPs assessed)] times 100. 

d. Percent of preschool children who improved functioning to reach a level comparable 
to same-aged peers = [(# of preschool children who improved functioning to reach a 
level comparable to same-aged peers) divided by (# of preschool children with I EPs 
assessed)] times 100. 

e. Percent of preschool children who maintained functioning at a level comparable to 
same-aged peers = [(# of preschool children who maintained functioning at a level 
comparable to same-aged peers) divided by (# of preschool children with I EPs 
assessed)] times 100. 

Summary Statements for Each of the Three Outcomes 
(use for FFY 2008-2009 reporting) 

Summary Statement 1: Of those preschool children who entered the preschool program 
below age expectations in each Outcome, the percent who substantially increased their rate 
of growth by the time they turned 6 years of age or exited the program. 

Measurement for Summary Statement 1: Percent = # of preschool children reported in 
progress category (c) plus # of preschool children reported in category (d) divided by [# of 
preschool children reported in progress category (a) plus # of preschool children reported in 
progress category (b) plus # of preschool children reported in progress category (c) plus # 
of preschool children reported in progress category (d)] times 100. 

Summary Statement 2: The percent of preschool children who were functioning within 
age expectations in each Outcome by the time they turned 6 years of age or exited the 
program. 

Measurement for Summary Statement 2: Percent = # of preschool children reported in 
progress category (d) plus [# of preschool children reported in progress category (e) 
divided by the total # of preschool children reported in progress categories (a) + (b) + (c) 
+ (d) + (e)] times 100. 



FFY 


Measurable and Rigorous Target 


2008 


N/ A 



Overview of I ssue/ Description of System or Process 
Measurement System and Strategies Used to Collect Data 

Section 619 Indicator 7 measurement and reporting are administered by the Results Matter 
initiative at the Colorado Department of Education (CDE) and in collaboration with the 
Colorado Department of Human Services (DHS). Results Matter is a statewide program that 
promotes ongoing assessment and documentation of child learning and development for a 
total of 44,000 children served in a variety of early childhood initiatives such as Part C, 
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Head Start, private for- profits, non-profits, faith based and home based programs. It is a 
comprehensive outcomes and accountability system made up of multiple components 
including measurement and reporting of child and family outcomes, longitudinal analysis of 
achievement data, links to program quality indicators and an extensive professional 
development system designed to support high quality assessment practices and the use of 
data to inform decision making at multiple levels from classroom instruction to program 
improvement to local and state policy development. 

o Who is included in Indicator 7 measurement? Indicator 7 data in Colorado are 
based on census data for only those children eligible for special education services 
funded through IDEA Part B Section 619. Such students are assessed three times 
annually. 

o What are the sources of Indicator 7 data? Assessment and outcomes data are 
derived from one of three curriculum or criterion referenced assessment systems 
chosen by the local program. The process requires ongoing observation, portfolio 
documentation and periodic assessment ratings. The menu of approved assessment 
systems includes: Creative Curriculum Developmental Continuum (CCDC), Work 
Sampling System (WSS) and High/Scope Child Observation Record (COR). 

o Who conducts the assessments? The child’s primary caregiver is designated as the 
assessment lead and has the final word on all assessment decisions. Members of the 
classroom and intervention teams, as well as families and providers from other 
programs serving the child, contribute to the body of progress information which 
includes observations, work samples, digital photo and/or video files and rating 
scales. 

o When does assessment occur? Observation and documentation are ongoing, 
culminating in assessment rating checkpoints for all children scheduled three times 
per school year (four checkpoints for year round programs). Checkpoints for 
Colorado are October 29, February 14 and May 31. 

o How are data transmitted to the state? All assessment information, including 
observation notes and other forms of documentation, is entered online using secure 
systems hosted by the assessment vendors. These online assessment systems 
provide immediate access to child and group level data reports for teachers, local 
administrators and state administrators. Both status and progress reports are 
available and can be generated based on developmental or content domain, 
outcomes or state standards. 

o What methods are used to determine progress categories? Conversion to the OSEP 
progress categories is achieved through an automated process calibrated to each of 
the assessment tools. Results Matter has been working closely with the assessment 
authors, researchers and the Early Childhood Outcomes Center (ECO) to fine tune 
these algorithms. Although further adjustment is needed to address issues of over 
representation in some categories, great strides have been made in the past year 
that have allowed Colorado to capture a much more comprehensive statewide data 
set. 

Data System Elements 

o Data Input and Maintenance Vendor hosted online assessments systems function as 
the portal for data input at the classroom level and also currently serve as a data 
warehouse for information entered beginning in 2005. Security of the online 
systems was vetted by the CDE Information Management Services Unit (IMS). Local 
programs are instructed to archive data from prior years rather than delete. System 



Part B State Performance Plan: 2005-2010 
(OMB NO: 1820-0624 / Expiration Date: 2/29/2012) 



Page 57 of 176 




SPP Template - Part B (3) 



Colorado 



wide exports of data are also carried out routinely and data files are stored at the 
CDE. All automated reports can be run with or without archived records included. 

o Data Analysis Status, progress and correlation reports can be produced at all 
administrative levels of the online systems. A Results Matter team member with 
expertise in data management and analysis was hired. 

Policies and Procedures 

Policies and procedures guiding the Results Matter outcomes measurement system are 
partly built into the procedures for the assessment itself and the accompanying online 
system. Other policies and procedures are outlined in a series of Results Matter 
Implementation Guidelines. A process is in place to compile written guidance in a Results 
Matter handbook to be completed by fall 2010. Guidance is communicated to providers 
through email, online system alerts and through the website at 
http://www.cde.state.co.us/resultsmatter/rm docs.htm . 

Provision of Training and Technical Assistance 

Training continues to be a cornerstone of the Results Matter program. The addition of five 
(5) consultants who support the implementation of Results Matter in inclusive settings 
enabled a higher level of local technical assistance during the 2008-09 school year. Training 
and technical assistance in the areas of observation, documentation, and specific 
assessment tool use, as well as skill building in the use of digital documentation and the 
online system are provided on a regional schedule and upon request. The Results Matter 
observation module training materials were made available online and have been 
disseminated nationwide. The documentation module is being revised with a release date of 
J une, 2010 in Colorado followed by national dissemination at the OSEP conference in 
August, 2010. At the end of 2009, the Results Matter video series was also made available 
on the website where users can stream the video clips or download them for later use. 
Plans were put into place to develop and host interactive online training options with access 
to an interactive presentation software system. Some training materials can be found at: 
htt p://www.cde.state.co.us/resultsmatter/observation.htm . There is a Results Matter Video 
Library that can be found at: http://www.cde.state.co.us/ resultsmatter/ RMVideoSeries.htm . 

Quality Assurance and Monitoring 

Advances in implementing quality assurance strategies in FFY 2008 included multiple 
components: 

1. Increased site visits with personalized technical assistance to support quality 
assessment practices. 

2. A shift from a training-of-trainers model to a direct, state-sponsored training for local 
teachers and administrators on the topic of introductory and advanced assessment. 

3. Complete revision and field testing of an observation skills module. 

4. Sponsorship of a second assessment roundtable series. 

5. Plans put into place for increased administrator training to build local capacity for 
quality monitoring. 

6. Continued work with publishers and ECO to refine conversion algorithms and to 
continue to build out the online system to provide ways to easily monitor levels of 
implementation. 
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7. ECO used remaining Colorado General Supervision Enhancement Grant (GSEG) funds 
to run preliminary analyses, including pattern checking, of statewide data. 

8. Plans put into place to continue a partnership with ECO and also a research analysis 
team at the University of Northern Colorado (UNC) to assist with data analysis and 
monitoring beginning in FFY 2009. 



Progress/ Baseline Data (Preschool Children Exiting During FFY 2008) 



Table 7.1 Positive social-emotional skills (including social relationships): 



A. Positive social-emotional skills (including social 
relationships) : 


Number of 
Children 


% of 
Children 


a. Percent of preschool children who did not improve functioning 


104 


3.1% 


b. Percent of preschool children who improved functioning but not 
sufficient to move nearer to functioning comparable to same- 
aged peers 


246 


7.3% 


c. Percent of preschool children who improved functioning to a 
level nearer to same-aged peers but did not reach it. 


455 


13.5% 


d. Percent of preschool children who improved functioning to reach 
a level comparable to same aged peers 


739 


21.9% 


e. Percent of preschool children who maintained functioning at a 
level comparable to same-aged peers 


1829 


54.2% 


Total 


3373 


100.0% 
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Table 7.2 Acquisition and use of knowledge and skills (including early 
language/ communication and early literacy): 



B. Acquisition and use of knowledge and skills (including 
early language/ communication and early literacy): 


Number of 
Children 


% of 
Children 


a. Percent of preschool children who did not improve functioning 


121 


3.6% 


b. Percent of preschool children who improved functioning but not 
sufficient to move nearer to functioning comparable to same- 
aged peers 


269 


7.9% 


c. Percent of preschool children who improved functioning to a 
level nearer to same-aged peers but did not reach it. 


594 


17.5% 


d. Percent of preschool children who improved functioning to reach 
a level comparable to same aged peers 


630 


18.6% 


e. Percent of preschool children who maintained functioning at a 
level comparable to same-aged peers 


1781 


52.5% 


Total 


3395 


100.0% 



Table 7.3 Use of appropriate behaviors to meet their needs: 



C. Use of appropriate behaviors to meet their needs: 


Number of 
Children 


% of 
Children 


a. Percent of preschool children who did not improve functioning 


99 


2.9% 


b. Percent of preschool children who improved functioning but not 
sufficient to move nearer to functioning comparable to same- 
aged peers 


283 


8.3% 


c. Percent of preschool children who improved functioning to a 
level nearer to same-aged peers but did not reach it 


505 


14.8% 


d. Percent of preschool children who improved functioning to reach 
a level comparable to same aged peers 


670 


19.7% 


e. Percent of preschool children who maintained functioning at a 
level comparable to same-aged peers 


1848 


54.3% 


Total 


3405 


100.0% 
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Discussion of Progress Data 

Complete Data: Improved functioning of online systems over the past year and increased 
emphasis on data clean-up with individual sites and programs has led to a significant 
increase in the amount of data Colorado has to report for FFY 2008. 

Although an independent analysis of all Results Matter child assessment data revealed a 
high percentage of missing data, it should be noted that this particular analysis excluded 
assessments when even 1 item was left un-scored. The assessments and outcomes 
conversion formulas have a preset threshold for missing items so it is quite possible that 
many of the excluded assessment results would actually be included in most day to day 
reporting functions. 

With data for close to 3400 children included in this SPP/APR submission, it is evident that 
efforts to improve completeness of data are paying off. However, there are significant 
concerns over some assessments remaining incomplete and the action plan at the end of 
the Indicator 7 section includes activities that address this. The breakdown of child 
outcomes measurements completed across the three assessment systems in Results Matter 
is depicted in this chart. We would expect there to be similar numbers generated by the 
COR assessment community as Work Sampling, but it is evident there is some sort of issue 
and plans are in motion to work with the publisher and local programs to try to understand 
why there is so much missing data in this area. 




Representative Data: Data included in this report represent children served in rural 

remote, rural resort, rural farming, urban and suburban communities from every region of 
Colorado. Indicator 7 data reflect approximately 3400 preschool children, 69% male and 
31% female, who completed preschool in FFY 2008. In this data set a breakdown of 
race/ ethnicity data indicated 63% White, 28% Hispanic, 5% Black or African American, 2% 
Asian, 1% American Indian/Alaskan Native and 2% all others, which is similar to averages 
in Colorado. 
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Indicator?: 
Preschool 
Children by 
Gender 

B Male 
□ Female 



Indicator 7: Preschool Children by Race/Ethnicity 




I White 

■ Hispanic/Latino 

■ Black or African 
American 

■ Asian 



■ American Indian/ 
Alaskan Native 

■ All Others 



Outcomes Data Combined Across the Three Assessments: Great improvements have 
been made in the use of the online systems to automatically generate outcomes data and 
the work to refine these formulas continues. However, conversion data for some of the 
assessments is still producing a high number of ratings in OSEP Progress Category "e", 
while another assessment used in Colorado is producing higher than expected numbers in 
Category "c". These differently flawed results occur because of unique differences in the 
way the particular vendor's work group approached the development of the algorithm, 
establishment of cut points and how various assessment items feed each outcome. In other 
words, all three assessment data sets are producing some puzzling automated reports but 
for different reasons. 



The tables above show combined Colorado data which look promising on the surface, but 
because results within each of the assessment systems are still out of balance and because 
we are missing so much of the COR data, we recognize that there is more work to be done 
before we can have complete confidence in our outcomes information. The teams working 
on these conversion revisions are extremely close to a solution, but unfortunately there was 
not a ready solution in time for the submission of the APR. 

Overall Assessment Data Quality: An analysis of Colorado data reflecting 17,597 

children from a cross section of programs, communities and funding streams was completed 
at the end of 2009, yielding the following information. 



Colorado Data 




National Data 
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It is an established finding that developmental abilities increase from birth to 7 years of age 
(Santrock, 1999). This finding has been demonstrated across most developmental 
assessments (e.g. BDI-II, Newborg, 2005). This relationship should lead to high correlations 
between chronological age and raw score or chronological age and developmental age. 
Correlations are moderate and in the expected direction for Creative Curriculum 
Developmental Continuum® and High/Scope COR. The correlations for WSS-P3 and WSS-P4 
are very small. 

An important feature of instruments that are used to measure progress is the sensitivity of 
scores to change over time. More children showed progress on The Creative Curriculum 
Developmental Continuum® and High/Scope COR compared to the WSS-P4 and WSS-P3 1 . 
This difference could be a function of the programs using the different tools, the children 
they serve, or a characteristic of the tool itself. In general, a larger percentage of children 
demonstrated progress in Outcome B and the lowest number of children demonstrated 
progress in Outcome C. This could result from the larger focus of the preschool curriculum 
on Outcome B or that the skills measured in Outcome B are easier or more amenable to 
change. 



1 WSS-P4 and WSS-P3 refers to the Work Sampling System for 4 and 3 year olds. 
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Targets for Preschool Children Exiting in 
FFY 2009 (2009-10) and FFY 2010 (2010-2011) 
and Reported in Feb 2011 and Feb 2012 



Summary Statements 


Baseline 
FFY 2008 
(% of children) 


Targets 
FFY 2009 
(% of children) 


Targets 
FFY 2010 
(% of children) 


Outcome A: Positive social-emotional skills (including social relationships) 


1. Of those children who entered or exited 
the program below age expectations in 
Outcome A, the percent who substantially 
increased their rate of growth by the time 
they exited the program 


77.3% 


77.8% 


78.3% 


2. The percent of children who were 
functioning within age expectations in 
Outcome A by the time they exited the 
program 


76.1% 


76.6% 


77.1% 


Outcome B: Acquisition and use of knowledge and skills (including early 
language/ communication and early literacy) 


1. Of those children who entered or exited 
the program below age expectations in 
Outcome B, the percent who substantially 
increased their rate of growth by the time 
they exited the program 


75.8% 


76.3% 


76.8% 


2. The percent of children who were 
functioning within age expectations in 
Outcome B by the time they exited the 
program 


71.0% 


71.5% 


72.0% 


Outcome C: Use of appropriate behaviors to meet their needs 


1. Of those children who entered or exited 
the program below age expectations in 
Outcome C, the percent who substantially 
increased their rate of growth by the time 
they exited the program 


75.5% 


76.0% 


76.5% 


2. The percent of children who were 
functioning within age expectations in 
Outcome C by the time they exited the 
program 


74.0% 


74.5% 


75.0% 



Required response to FFY 2007 APR 

None required. 
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Discussion of I mprovement Activities 



Colorado has established, in the SPP, improvement activities for Indicator 7 through FFY 
2010. The table below displays the improvement activities that have occurred as well as 
the progress and current status of each. 



Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


1. Provide briefings about 
the Results Matter child 
and family outcomes 
initiative for broad 
stakeholder groups. 


FFY 2008 
FFY 2009 


Posted full overview DVD on 
website 

http://www.cde.state.co.us/ res 
ultsmatter 

Published overview in State 
Preschool Program Legislative 
Report found at 

httD:// www. cde. state, co. us/cdd 
/download/CPPDocs/2009 Leai 
slative Reoort.odf . 

Briefed: 

• University of Colorado- 
Denver graduate students. 

• State Preschool Program 
local coordinators. 

• Briefed staff at Rise School 
(local private school for 
young children with 
disabilities). 

Presented at the Lt Governor's 
Progress and Possibilities 
Conference. 

Presented at the Early 
Childhood Outcomes 
Conference. 


O 
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Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


2. Strengthen reliable use 
of assessment by 
providing ongoing 
observation, 
documentation and 
assessment instrument 
training as well as 
training in use of the 
online assessment 
systems for providers 
and administrators. 


FFY 2008 
FFY 2009 
FFY 2010 


Conducted four assessment 
training-of-trainers workshops. 

Conducted 20+ observation 
and documentation trainings. 

Completed comprehensive 
revision and field test of 
observation module. 

Posted observation module 
materials on web and 
disseminated nationally 
htto:// www.cde.state.co. us/ res 
ultsmatter/observation.htm 

Developed and disseminated 
print instructions for OSEP 
entry/exit process for all online 
assessment systems. 


O 








3. Collect and analyze data 
for use at the federal, 
state and local levels to 
inform families, child- 
level planning, local 
program level training 
and statewide technical 
assistance. 


FFY 2008 
FFY 2009 
FFY 2010 


Assessment data from more 
than 30,000 children were 
entered into the online system. 

The CDE staff have received 
training from assessment 
trainers in order to better 
understand data and be able to 
use the data to inform technical 
assistance to service providers. 

Continued to refine data 
collection systems with the help 
of the assessment publishers 

Continued to develop systems 
to facilitate the use of the state 
student identifier system. 

Conducted preliminary level 
data quality review. 


O 
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Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


C 


R 


D 


4. 1 incorporate findings and 
lessons learned from 
data analysis into state 
level planning for 
training, technical 
assistance and 
monitoring activities. 


FFY 2008 


The CDE determined this to be 
an ongoing administrative task 
rather than an improvement 
activity targeted at improving 
results so it is being deleted. 








D 


5. Develop and implement 
a "Level 1 1 " assessment 
instrument training 
module for providers 
using each of the three 
tests to increase reliable 
implementation. 


FFY 2008 


Determined to be addressed in 
Improvement Activity # 2 
above. 








D 


6. Develop and implement 
systematic training and 
technical assistance for 
local program 
administrators to 
support their ability to 
effectively supervise, 
monitor and improve 
their staff's reliable use 
of assessment tools. 


FFY 2008 


Determined to be addressed in 
Improvement Activity # 2 
above. 








D 


7. Assist with analysis of 
conversion to the COSF 
Scale and with 
refinement of the 
calibration of the 
assessment tools to the 
COSF. 


FFY 2008 


The CDE determined that this is 
an ongoing administrative task 
and not an improvement 
activity targeted at improving 
results so it is being deleted. 








D 


8. Assist with analysis of 
assessment data to 
determine if refinements 
to the actual assessment 
items for certain tools 
may be needed. 


FFY 2008 


The CDE determined that this is 
an ongoing administrative task 
and not an improvement 
activity targeted at improving 
results so it is being deleted. 








D 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


9. Develop and implement 
professional 
development resources 
on linking assessment to 
planning instruction and 
intervention. 


FFY 2008 
FFY 2009 


Training needs were reviewed 
and revised. 

A process identified to create 
professional development 
resources on linking 
assessment with instruction 
and intervention in FFY 2009 
and FFY 2010. 


O 









Revisions, with I ustification. to Proposed Targets / I m prove merit Activities / 
Timelines / Resources for FFY2008 

Improvement activities are being added to reflect current practice. 



Revised I mprovement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. Provide briefings 
about the Results 
Matter child and 
family outcomes 
initiative for broad 
stakeholder groups. 


Brief staff from Lt Governor's office. 

Present at Colorado Association for 
Education of Young Children (CAEYC) 
annual conference. 

Brief Clayton Early Learning Institute 
leadership. 

Brief Senate Bill 212 (School 
Readiness) Work Group. 

Revise printed information brief and 
disseminate. 

Present at Association for Christian 
Schools International conference. 

Publish updated overview in 2010 
state preschool legislative report. 

Brief federal early childhood 
representative(s). 


FFY 2009 


Revised PPT 
presentation 

Video series 
highlights 
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Activity 


Action Steps 


Timeline 


Resources 


2. Strengthen reliable 
use of assessment 
by providing ongoing 
observation, 
documentation and 
assessment 
instrument training 
as well as training in 
use of the online 
assessment systems 
for providers and 
administrators. 


Provide webinars on use of the online 
systems. 

Provide introductory and advanced 
assessment supervision training for 
administrators. 

Continue to provide rounds of 
introductory and advanced 
assessment instrument training for 
new and continuing local staff. 

Conduct complete review and revision 
documentation module. Field test 
and prepare for broad dissemination 
by August, 2010. 

Provide ongoing site visits and 
technical assistance to monitor and 
assist with local implementation. 

Provide ongoing random checks of 
observation and assessment data 
quality and train local administrators 
to conduct these checks locally. 


FFY 2009 
FFY 2010 


Purchase 
agreements with 
vendors 

Content plans 

Training staff 

Print training 
resources 

Videography and 
video editing 
services 

Field TA staff 

TA plans 

Online system 
access 

Plans for 

systematizing 

monitoring 


3. Collect and analyze 
data for use at the 
federal, state and 
local levels to inform 
families, child-level 
planning, local 
program level 
training and 
statewide technical 
assistance. 


Publish quarterly checkpoint 
deadlines and assessment window 
information. 

Assure local access to online systems, 
print materials and required trainings. 

Monitor entry status and assessment 
completion. 

Send periodic reminders. 


FFY 2009 
FFY 2010 


Online 

subscription 

process 

Online access 
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Activity 


Action Steps 


Timeline 


Resources 


4. Develop and 
implement 
professional 
development 
resources on linking 
assessment to 
planning instruction 
and intervention. 


Identify subject matter experts to 
assist with content. 

Identify lead and work group 
members. 

Conduct literature/ resources review. 
Refine plan to include: 

• Traditional and web based 
learning objects 

• Map for video resource needs 

• Details for online interactive 
learning 

• Examples for case study 
method 

Produce draft materials. 

Conduct pilot- revise-field test- revise 
process. 

Finalize and disseminate electronic 
and print resources. 

Schedule local events. 


FFY 2009 
FFY 2010 


Product 

developer 

Suggestions 
of possible 
development 
team 
members 

Books and 
other 
resource 
materials 

Videographer 

Video editing 
service 

Articulate 

Studio 

Camtasia 

Volunteer 
programs for 
pilot/field 
test 

Training 

calendar 


5. 1 mprove completion 
rate of assessments 
in programs where 
High/Scope Child 
Observation Record 
is used. 


Consult with Fligh/Scope and Red-e 
Set Grow about possible reasons for 
so many incomplete assessments. 

Schedule mandatory training for 
participating districts. 

Assign field staff to closely monitor 
and provide feedback/support to 
struggling programs. 

Discuss issue with special education 
directors. Notify superintendents if 
needed. 


FFY 2009 


Staff at both 
companies 

Training 

materials 

Field staff 

Research and 
data consultant 
staff 
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Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: FAPE in the LRE 



Indicator 8: Percent of parents with a child receiving special education services who report 
that schools facilitated parent involvement as a means of improving services and results for 
children with disabilities. 

(20 U.S.C. 1416(a)(3)(A)) 



Measurement: 

Percent = # of respondent parents who report schools facilitated parent involvement as a 
means of improving services and results for children with disabilities divided by the total # 
of respondent parents of children with disabilities times 100. 



PARENT INVOLVEMENT: K-12 
Overview of I ssue/ Description of System or Process 

Colorado’s Exceptional Student Services unit has been collecting data from parents for 
many years and then, more recently, as part of its updated monitoring efforts with 
students on lEPs on a yearly basis since 2001 as part of its CIMP process. This effort 
has historically involved a Web-based surveying effort using a sample of school districts 
every year. As part of Colorado's effort to adequately respond to this effort in the 
future, the CDE will conduct a cross-walk between the existing parent survey and the 
National Center for Special Education Accountability Monitoring (NCSEAM) survey to 
develop a hybrid version that allows CDE to continue to assess trend data from previous 
years while also meeting the needs of this new indicator. While the Web-based system 
is already in place, response rates have been historically low, pointing to a need to 
develop strategies to get more parents to participate in the survey effort. Although it is 
anticipated that the Web-based system will be continued into the foreseeable future, the 
CDE also intends to create alternative mechanisms for parents to participate so that 
response rates increase over time. The CDE also intends to continue to work more 
closely with Administrative Units (AU) to improve communications and other locally- 
based strategies to further encourage parent participation. 

Colorado will provide clear, quantifiable baseline data for FFY 2005 that will be collected 
annually thereafter. 

February 2007 Update: The process of updating the Parent Survey has been delayed by 
one year for two reasons. First, given the large number of data collection and analytic 
updates being addressed in FY2005, priority was to those systems which were deemed 
most critical for the reporting of valid and reliable data on Colorado's APR. These 
include collections such as the December Count, End of Year Report, and the Student 
Record Review; and analytic mechanisms and procedures to support reporting on 
Indicator 4 on Suspension Expulsion and Indicators 9 and 10 on Disproportionality. 
Because the CDE already had a mechanism in place for collecting information on LEA 
facilitation of parent involvement as a means of improving services and results for SWD, 
the CDE pushed back the process on creating a hybrid version of the parent survey as 
described above. The second reason why the CDE delayed the development and 
implementation of the hybrid survey has to due with the fact that in FY2005, the final 
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batch of Administrative Units were entered into the 5 year Continuous Improvement 
Monitoring process (CIMP). Because the parent survey is an integral piece of CIMP, 
maintaining consistency in the survey for all AUs in the original 5 year sampling plan 
was deemed important. Moving forward, the CDE anticipates a major update of the 
CIMP process to align better with State Performance Plan requirements and as part of 
this effort, the CDE is currently working on how to best utilize parent survey data for 
both the CIMP process while at the same satisfying the data collection requirements of 
the SPP. 

The CDE also believes that although the hybrid version will yield greater measurement 
sensitivity and better information for developing strategies to improve performance, it 
feels that a direct comparison between results from the existing the survey and the 
hybrid version will be possible for reporting purposes in Colorado's FY2005 APR. The 
CDE is currently in the process of finalizing the questions and hopes to use the updated 
version in its spring 2007 data collection effort. 

For the data reported as baseline for FFY2005, the CDE derived a composite score based 
on the responses to the following items from the Parent Survey (see Exhibit A and B for 
this indicator, sent as an attachment to this SPP update, for a copy of the entire survey 
used in FY2005): 

In preparation for the Individualized Education Program (IEP) meeting were 
you informed about assessment plans (testing) for your child, to determine 
skills and/ or eligibility or continued eligibility for special education services? 
(scoring 1 point for yes, 0 for no and missing) 

Were you asked to provide input for the assessment plans (testing) for your 
child? (Scoring: 2 points for yes, 0 points for no and missing) 

Did you receive any assessment results (testing) before the Individualized 
Education Program (IEP) meeting? (Scoring: 3 points for yes, 0 points for no 
and missing) 

Were you given timely notice of the Individualized Education Program (IEP) 
meeting? (Scoring: 2 points for yes, 0 points for no and missing) 

At your child's most recent I ndividualized Education Program ( I EP) meeting, on 
a scale of 1-5 (with 5 being best) how well was your input valued? (Scoring: 0 
to 4 points, respectively) 

Do you receive regular reports on your child's progress toward the annual 
goals listed on the Individualized Education Program (IEP)? (Scoring: 3 points 
for yes, 0 points for no and missing) 

At your child's last Individualized Education Program (IEP) meeting did you 
provide input about your child's participation in statewide testing (CSAP or 
CSAPA)? (Scoring: 3 points for yes, 0 points for no and missing) 

Has the school district/ Board of Cooperative Educational Services (BOCES) 
provided you adequate information and training on your child's special needs? 
(Scoring: 3 points for yes, 0 points for no and missing) 
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Has the school district/ Board of Cooperative Educational Services (BOCES) 
provided you adequate information and training to support your child's 
Individualized Education Program (IEP) goals and objectives? (Scoring: 1 point 
for yes, 0 points for no and missing) 

Does the district/ Board of Cooperative Educational Services (BOCES) provide 
you with information about any parent trainings or workshops? (Scoring: 2 
point for yes, 0 points for no and missing) 

Scoring for each item was done so each area of inquiry or factors accounted for an 
appropriate portion of the overall score and that items within factors were weighted in 
terms of relative importance. Individual item scores were summed for each respondent 
and then divided by 4 to decrease the range in the overall composite score, yielding a 
range of 0 to 6. The CDE chose a fairly conservative minimum cut-off of 4 points or 
higher to consider a parent's response as one that reflects adequate facilitation of parent 
involvement on the part of the AU. The Figure on the next page shows the distribution 
of scores for data used in the baseline calculation for FY2005, with the cut-off for 
adequate facilitation shown by the vertical bar. 



Distribution of "Facilitating Parent Involvement" Scores 




Mean =3.3438 
Std. Dev. =1.49679 
N =2,935 
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Baseline Data for FFY 2005 (2005-2006) : 40.2% 

> 1181 of respondent parents reported that schools facilitated parent involvement 
as a means of improving services and results for children with disabilities divided 
by the total of 2,935 respondent parents of children with disabilities times 100. 

Discussion of Baseline Data 

A total or 2,935 parents of SWD from 18 Alls in geographically varied areas of the state 
responded to the survey. A comparison of the Alls on key characteristics to state 
percentages is presented on the next page. As seen in the table, the Alls in the sample 
mirror the state percentages rather well. 



% 

SPED 

Within 

Total 

Pop. 



Percent Within SPED 



% LD 



% % All 

% ED % MR Speech/ Other 

Language Dis. 



% % 

Female Minority 



% ELL 
Within 
Total 
Pop. 



Sampled 

AUs 



10 . 0 % 



State 10.6% 



35.2% 10.0% 

36.5% 10.0% 



3.8% 



4.2% 



26.4% 

24.8% 



24.6% 

24.7% 



32.3% 

32.4% 



34.7% 

38.2% 



13.5% 

12 . 8 % 



Although the above table demonstrates that the AUs in the sample represent the state 
rather well on these key characteristics, relatively low return rates (<20% overall) from 
each AU undermine the extent to which the respondents from each AU represent the 
parents from the district as a whole. Unfortunately, the current parent survey does not 
include student demographic information that would allow for a thorough comparison to 
state and AU characteristics. The survey does, however, collect information on the 
student’s primary disability, and this comparison is shown in the table below. While this 
comparison is encouraging in that it roughly mirrors that state and AU percentages, it 
points to the need to collect additional student demographic data in future surveying 
efforts. 





% LD 


% ED 


% MR 


% 

Speech/ Language 


% All Other 
Disabilities 


Survey 

Respondents 


32.6 


8.6% 


4.7% 


23.4% 


30.7% 


Sampled AUs 


35.2% 


10.0% 


3.8% 


26.4% 


24.6% 


State 


36.5% 


10.0% 


4.2% 


24.8% 


24.7% 



Also, once the survey update is completed, the CDE will work on additional strategies to 
improve return rates. Return rates improves somewhat in FY2005 (about 3 to 5% for 
most AUs), the overall rates are still quite low. During spring 2007, the CDE will pilot 
the use of hardcopy mail-outs with postage- paid return envelopes to assess whether this 
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will substantially improve return rates. Because of the significant additional cost in this 
surveying method, the CDE will not implement this strategy unless it is shown to 
substantially improve return rates in the pilot. 

Note that the existing parent survey is offered in both English and Spanish and parents 
have the option of calling a toll-free number to complete the survey over the phone in 
either of these two languages. The CDE intends to continue to offer these options for 
the updated survey. 



FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 




2006 

(2006-2007) 


45% 


2007 

(2007-2008) 


50% 


2008 

(2008-2009) 


55% 


2009 

(2009-2010) 


60% 


2010 

(2010-2011) 


65% 
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I mprovement Activities/ Timelines/ Resources (Revised) 

In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


1. Conduct survey with 
representative sample of 
Administrative Units 
(AUs). 


FFY 2007 


Survey completed with AUs in 
the sampling plan. 




c 






2. Review baseline data, 
set targets and develop 
improvement activities. 


FFY 2005 
FFY 2006 
FFY 2007 


Baseline and targets were 
identified in 2005. 

Improvement activities will be 
identified each year through the 
APR. 




c 






3. Pilot hard-copy survey 
mail-outs with postage- 
paid reply envelopes. 


FFY 2008 


A pilot was not conducted. 

1 nstead, for the FFY 2008 
survey, each parent in the AUs 
that participated received a 
hard copy survey with a 
postage-paid envelope. 
Families were provided the 
mail-in option, in addition to 
the email, fax, online and 
telephone options. 




c 






4. 1 ncrease access to the 
survey for parents 
whose languages are 
other than English. 


FFY 2007 
FFY 2008 


The CDE determined this to be 
an ongoing administrative task 
rather than an improvement 
activity targeted at improving 
results so it is being deleted. 








D 


5. Collaborate with the 
CSEAC on an Official 
Position Statement with 
regard to improving 
parent involvement. 


FFY 2007 
FFY 2008 
FFY 2009 


A Parent Involvement Fast 
Facts document has been 
drafted by CSEAC. 


O 
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Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


6. Analyze data and 
disseminate to 
Administrative Units and 
the public via the CDE 
Website. 


FFY 2006 
FFY 2007 


Data are included in public 
reports on the CDE website AT 
htto: // www. cde. state, co. us/cde 
soed/AUDerformanceorofiles.as 
fi- 




c 






7. Identify strategies for 
focused monitoring and 
provision of technical 
assistance based on 
parent survey results. 


FFY 2007 
FFY 2008 
FFY 2009 


Use current data 

Continue to gain input from 
directors, CSEAC, PEAK and 
other stakeholders. 


O 








8. 1 ncrease cross unit 
collaboration within the 
CDE focused on parent 
involvement to identify 
opportunities with the 
CDE Communications 
Unit to disseminate 
special education related 
information to parents. 


FFY 2008 
FFY 2009 
FFY 2010 


Continue to update materials 
(i.e., IEP Manual, CDE Fast 
Facts) regarding parent 
involvement and work with the 
CDE Communications Unit to 
disseminate. 


O 








9. The CDE sponsors 
and/or supports 
conferences throughout 
the year that enhance 
parent and family 
involvement. 


FFY 2007 
FFY 2008 
FFY 2009 


These activities are ongoing 
within the state. 


0 








10. 1 mprove communication 
with families and 
increase the marketing 
of the survey to improve 
the response rate. 


FFY 2008 


Cover letter was revised to 
improve communication about 
purpose of survey. 
Correspondence to families 
receiving the survey was 
personalized. 




c 
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Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


11. Collect information about 
effective parent 
involvement from a 
variety of sources. 


FFY 2008 
FFY 2009 


A Family and Community 
Engagement Training of 
Trainers' module was developed 
and training was provided. 

An RFP was developed to 
conduct a literature review and 
develop curriculum on Effective 
Family-School Partnerships. 


O 


c 






12. Revise parent survey 
questions to better 
measure parent/family 
involvement and 
engagement. 


FFY 2010 


The CDE determined this to be 
an ongoing administrative task 
rather than an improvement 
activity targeted at improving 
results so it is being deleted. 








D 


13. Contract with a third 
party vendor to manage 
the 1 ndicator 8 data 
collection. 


FFY 2009 
FFY 2010 


Contracting with a third party 
vendor continues to be 
considered as CDE addresses 
this and other data collection 
efforts. 


O 








14. Collaborate with various 
parent/family 
organizations on 
statewide strategies for 
improving parent 
involvement. 


FFY 2008 
FFY 2009 
FFY 2010 


Collaborated with: 

Colorado's OSEP-designated 
Parent Training and Information 
Center and Region 5 Parent 
Technical Assistance Center 
(PEAK Parent Center). 


0 









Resources Used to Support Activities 

• CDE ESLU personnel 

• CDE webmaster 

• Contract with PEAK Parent Center 

• CSEAC 

• Special Education Directors 

• Indicator 8 budget included funds for improvement activities and costs associated 
with conducting survey 
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• OSEP consultation 

• MPRRC consultation 

• Research in family engagement practices and other states' performance plans 



Revisions for FFY 2008 

Improvement activities are being added to reflect current practice and continue through FFY 
2010 . 



Revised I improvement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. Collaborate with CSEAC, 
PEAK Parent Center and 
Parent to Parent to 
provide outreach to AU 
special education advisory 
committees (SEACs) on 
strategies to improve 
parent involvement. 


Increase use of AU SEAC 
listserv to disseminate 
information and share 
strategies. 

Hold a Spring 2010 meeting 
with AU SEACs to network 
and share strategies. 


FFY 2009 
FFY 2010 


ESLU staff 

CSEAC 

AU SEACs 

PEAK Parent 
Center 

Parent to 
Parent of 
Colorado 

Special 

Education 

Directors 


2. Develop and provide 
training to AUs in 
strategies for developing 
and maintaining parent 
involvement and effective 
family and school 
partnerships. 


Complete a literature review 
of effective family school 
partnerships. 

Develop training for soliciting, 
maintaining and maximizing 
parent involvement and 
effective school partnerships. 

Select pilot sites for 2010- 
2011 implementation of 
training on parent 
involvement and effective 
family school partnerships. 


FFY 2009 
FFY 2010 


ESLU Staff 

PEAK Parent 
Center 

Special 

Education 

Directors 
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Activity 


Action Steps 


Timeline 


Resources 


3. Connect educators and 


Regional Parent/Family 


FFY 2009 


ESLU Staff 


families of children with 
disabilities to resources to 
increase parent 
involvement. 


Mentor Services will be 
provided to connect families 
and educators to a variety of 
resources that will increase 
their understanding and 
knowledge of 1 DEA special 
education requirements, 
procedural safeguards, 
quality instructional practices 
for children with disabilities 
and effective family and 
school partnerships. 


FFY 2010 


PEAK Parent 
Center 



Sampling Plan 

The CDE intends to continue the use of sampling of AUs over the remaining period of 
Colorado's FFY2005-2010 State Performance Plan. In fall 2006, the CDE developed a 5 
year sampling plan for the remaining five years of Colorado’s SPP. All AUs that 
participated in the baseline data collection described above were re-entered into the 5 
year sampling plan. Therefore, all of Colorado’s 57 Administrative Units will participate 
in the Parent Survey data collection between FFY2006 and FFY2010. 

The sampling calculator developed by the National Post School Outcomes Center was 
used for the purpose of developing the 5 year sampling plan. AU characteristics that 
were factored into the process were as follows: 

• Number of AUs 

• AU region (urban/suburban vs. rural) 

• AU size 

• Percent of AU population disabled 

• Percent of SPED population in 4 disability categories (LD, ED, MR and all other 
disabilities) 

• Gender of SPED population 

• Percent of SPED population that is non-white (total minority) 

• Percent of SPED population that is Hispanic 

• Percent of SPED population that is 15 years of age or older 

The CDE drew approximately 35 separate plans using the sampling calculator and 
considered 20 of them. Serious consideration was given to the 6 best solutions. While 
all the solutions had difficulty containing year-to-year variation in the total minority and 
Hispanic variables within +/ 3 percentage points of the state percentage, the chosen plan 
maintained no more than +/- 3 percentage points variation from the state for all the 
disability categories and provided the best solution in terms of the variation in 
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race/ ethnicity over the 5 years of the plan. This was especially true for the percent 
Hispanic variable, which is a key demographic variable in Colorado. 

The comparison of each year's sample to the overall state percentages is shown in the 
table on the next page. The highlighted cells represent differences from the state 
percentage in excess of +/- 2 percentage points. The specific AUs that will be sampled 
in each year of the 5 year plan are shown in a subsequent table. 

The CDE intends to invite all parents of students with lEPs in the AUs from each year's 
sample to participate in the survey. As discussed earlier, the CDE is actively working on 
improving its response rates on the parent survey with the goal of exceeding 60% within 
2 years. If return rates do not dramatically improve within the next two years, the CDE 
may move away from trying to survey all parents in the AUs sampled each year to 
drawing a parent sample from each AU in the plan and using the off-set in resources to 
conduct extensive follow-up procedures with these parents. 

Finally, additional student demographic characteristics will also be collected to help 
assess the extent to which each year's respondents represent the state as a whole. 
Dependent on the outcome of this year-to-year assessment, the CDE may employ 
weighting techniques to help ensure comparability of the results over the 5 year period 
of the sampling plan. 

July 2007 Update: Sampling plan was updated because the Post-School Outcomes 

sampling calculator did not properly bring in the AUs with an average daily member ship 
of over 50,000 students. The yearly sample characteristics in the below tables does not 
reflect the four largest AUs that will sampled every year of the sampling plan. About 
20% of the parents from these large AUs will be randomly selected for participation in 
the survey per year. Additionally, the Colorado School for the Deaf and Blind will be 
included in the FFY2006 sample and Department of Youth Corrections will be included in 
the FFY2008 sample. This sampling plan is now identical to the plan for Indicators 13 
and 14 (Part C to B transitions and Post School Outcomes, respectively) based on 
feedback from the Colorado's Educational Data Advisory Committee (EDAC). 







Sample 




State 


FFY2006 


FFY2007 


FFY2008 


FFY2009 


FFY2010 


Size 


521393 


104724 


104886 


93094 


111399 


107560 


SPED 


57353 


11590 


11189 


10105 


11398 


10540 


% LD 


37 


38 


37 


36 


39 


36 


% ED 


10 


9 


9 


9 


10 


11 


% MR 


4 


5 


4 


5 


3 


4 


% AO 


49 


47 


50 


52 


48 


49 


% Female 


32 


33 


32 


32 


32 


32 


% Minority 


38 


35 


32 


45 


34 


34 


% Hispanic 


26 


27 


23 


27 


29 


25 


% 15 Years + 


23 


24 


23 


23 


23 


23 
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In the table below, the highlighted cells indicate the school year an administrative unit 
(All) or state operated program (SOP) is to submit demographic information in EOY 
reporting. **Please note that this sampling plan has not changed for Indicators 14 and 8. 
Aus with total student enrollment of 50,000+ will be sampled annually. 





1 ndicator 8 and 14 

Collection Year 

(demographic information) 


2006-07 

from EOY 
2005-06 


2007-08 

from EOY 
2006-07 


2008-09 

from EOY 
2007-08 


2009-10 

from EOY 
2008-09 


2010-11 

from EOY 
2009-10 


2011-12 

from EOY 
2010-11 


01010 


Adams 1, Mapleton 








X 






01020 


Adams 12, Northglenn 






X 








01030 


Adams 14, 
Commerce City 




X 










01040 


Adams 27 J , Brighton 










X 




01070 


Adams 50, Westminster 












X 


03010 


Arapahoe 1, Englewood 






X 








03020 


Arapahoe 2, Sheridan 




X 










03030 


Arapahoe 5, Cherry Creek 




X 


X 


X 


X 


X 


03040 


Arapahoe 6, Littleton 




X 










03060 


Adams- Arapahoe 28J, 
Aurora 








X 






07010 


Boulder RE-1J, St. Vrain 












X 


07020 


Boulder RE-2, 
Boulder Valley 










X 




15010 


Delta 50J 








X 






16010 


Denver 1 


X 


X 


X 


X 


X 


X 


18010 


Douglas RE-1 


X 


X 


X 


X 


X 


X 


21020 


El Paso 2, Harrison 












X 


21030 


El Paso 3, Widefield 








X 






21040 


El Paso 8, Fountain 








X 






21050 


El Paso 11, 
Colorado Springs 






X 








21060 


El Paso 12, 
Cheyenne Mountain 






X 








21080 


El Paso 20, Academy 








X 






21085 


El Paso 38, Lewis Palmer 










X 




21090 


El Paso 49, Falcon 




X 
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1 ndicator 8 and 14 

Collection Year 

(demographic information) 


2006-07 

from EOY 
2005-06 


2007-08 

from EOY 
2006-07 


2008-09 

from EOY 
2007-08 


2009-10 

from EOY 
2008-09 


2010-11 

from EOY 
2009-10 


2011-12 

from EOY 
2010-11 


21490 


Fort Lupton/Keenesburg 






X 








22010 


Fremont RE-1, 
Canon City 




X 










26011 


Gunnison RE-1J 










X 




30011 


Jefferson R-l 




X 


X 


X 


X 


X 


35010 


Larimer R-l, Fort Collins 












X 


35020 


Larimer R-2J, Loveland 












X 


35030 


Larimer R-3, Estes Park 












X 


38010 


Logan RE-1, Sterling 






X 








39031 


Mesa 51, Grand J unction 




X 










41010 


Moffat RE-1, Craig 








X 






43010 


Montrose RE-1J 




X 










44020 


Morgan RE-3, 
Fort Morgan 










X 




51010 


Pueblo 60, Urban 




X 










51020 


Pueblo 70, Rural 




X 










62040 


Weld RE-4, Windsor 




X 










62060 


Weld 6, Greeley 










X 




64203 


Centennial BOCES 












X 


64043 


East Central BOCES 






X 








64053 


Mount Evans BOCES 








X 






64093 


Mountain BOCES 










X 




64103 


Northeast BOCES 












X 


64123 


Northwest BOCES 










X 




64133 


Pikes Peak BOCES 






X 








64213 


Rio Blanco BOCES 












X 


64143 


San J uan BOCES 










X 




64153 


San Luis Valley BOCES 




X 










64160 


Santa Fe Trail BOCES 








X 






64163 


South Central BOCES 






X 








64193 


Southeastern BOCES 










X 




64083 


Southwest BOCS 








X 






64200 


Uncompahgre BOCS 












X 
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1 ndicator 8 and 14 

Collection Year 

(demographic information) 


2006-07 

from EOY 
2005-06 


2007-08 

from EOY 
2006-07 


2008-09 

from EOY 
2007-08 


2009-10 

from EOY 
2008-09 


2010-11 

from EOY 
2009-10 


2011-12 

from EOY 
2010-11 


64205 


Ute Pass BOCES 






X 








80010 


Charter School Institute 










X 




66050 


CSDB 




X 










66080 


Division of Youth 
Corrections 








X 
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Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: Disproportionality 



Indicator 9: Percent of districts with disproportionate representation of racial and ethnic 
groups in special education and related services that is the result of inappropriate 
identification. 

(20 U.S.C. 1416(a)(3)(C)) 



Measurement: 

Percent = # of districts with disproportionate representation of racial and ethnic groups in 
special education and related services that is the result of inappropriate identification 
divided by # of districts in the State times 100. 

Include State's definition of "disproportionate representation." 

Describe how the State determined that disproportionate representation of racial and ethnic 
groups in special education and related services was the result of inappropriate 
identification, e.g., monitoring data, review of policies, practices and procedures under 
618(d), etc. 

February 2008 Update 

State's definition of "disproportionate representation." 

As a result of OSEP's response to Colorado’s FFY 2005 SPP/APR, two methods were 
developed between the Fall of 2007 and January 2008 to define "disproportionate 
representation". Both methods examine each of 5 race/ ethnicity categories: 

1) American I ndian or Alaskan Native 

2) Asian or Pacific Islander 

3) Black (not Hispanic) 

4) Hispanic 

5) White (not Hispanic) 

Method 1: This method examines each Administrative Unit's (AU) percent of special 

education students in the five race/ethnicity categories and compares these percentages to 
the percent of the total education population in that AU for the same race/ ethnicity 
categories. A cell size of at least 30 special education students within any given 
race/ ethnicity category was set as the minimum to perform a comparison. Disproportionate 
over- representation is defined as a discrepancy of 10 or more percentage points between 
SPED and total education within any of the 5 race/ ethnicity categories while under- 
representation is defined as a discrepancy of 15 or more percentage points. 

Method 2: This method examines each AU's percent of total education students in the five 
race/ethnicity categories and sets upper and lower bounds. The upper bound for the five 
race/ ethnicity categories within each AU is computed by taking the total education 
percentages and multiplying each by 0.4 and then adding this result to the original 
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percentages. Similarly, the lower bounds for the five race/ ethnicity categories in each AU is 
computed by taking the total education percentages and multiplying by 0.5 and then 
subtracting this result from the original percentages. See the following table for an 
example. 



An Example of Setting Upper and Lower Bounds for an AU 





American 
1 ndian/ Alaskan 
Native 


Asian/ Pacific 
1 slander 


Black 


Hispanic 


White 


Percent 1 n 

Total 

Education 


6% 


10% 


24% 


28% 


32% 


Calculation 
for Upper 
Bound 


(6 X .4) + 6 


(10 X .4) + 
10 


(24 X .4) 
+ 24 


(28 X .4) 
+ 28 


(32 X .4) 
+ 32 


Upper 

Bound 

Result 


8.4% 


14% 


33.6% 


39.2% 


44.8% 


Calculation 
for Lower 
Bound 


6 - (6 X .5) 


10- (10X 
.5) 


24 - (24 
X .5) 


28 - (28 X 
.5) 


32 - (32 
X .5) 


Lower 

Bound 

Result 


3% 


5% 


12% 


14% 


16% 



Upper and lower bounds are set for the five race/ ethnicity categories for every AU. If an 
AU's SPED percentage within any race/ethnic category exceeds the upper bound, the AU 
meets the definition of disproportionate over-representation. If an AU's SPED percentage 
within any race/ethnic category is below the lower bound, the AU meets the definition for 
disproportionate under-representation. A cell size of at least 30 special education students 
within any given race/ ethnicity category was set as the minimum to perform a comparison. 
Additionally, a difference of at least +/- 2% under Method 1 was set as a minimum before 
any result under Method 2 would meet the definition of disproportionate representation. 

Overall, disproportionate representation in an AU is defined as having a discrepancy 
between SPED and total education in any of the five race/ ethnicity categories under the 
thresholds set in either Method 1 or Method 2. 

Significant Disproportionality is determined using the same two methods, but the 
thresholds involve a discrepancy of over 15% under Method 1 and calculating an upper 
bound using a multiplier of 0.8 rather than 0.4 under Method 2. For AUs that exceed these 
thresholds, in addition to a review of policies, procedures and practices, they will be 
required to allocate 15% of their following year's Part B funds for the provision of early 
intervening services. One AU was determined to have significant disproportionality under 
Indicator 9 for over- representation of Whites in special education under both methods. 



Part B State Performance Plan: 2005-2010 
(OMB NO: 1820-0624 / Expiration Date: 2/29/2012) 



Page 86 of 176 





SPP Template - Part B (3) 



Colorado 



Consistent with 34 CFR §§300. 646(b)(1) and 300.646(b)(3), the CDE is working with the 
identified AU to review policies, procedures. If it is determined that the All's policies and 
procedures are noncompliant, the CDE will require the AU to revise any such noncompliant 
policies and procedures and require the AU to public report on any such revisions. 

Describe how the State determined that disproportionate representation of racial 
and ethnic groups in special education and related services was the result of 
inappropriate identification, e.g., monitoring data, review of policies, practices and 
procedures under 618 (d), etc. 

Given the timing of Colorado’s FFY 2006 Student Count and the need to develop a definition 
of disproportionality based on every race/ ethnicity category rather than using "total 
minority”, the State did not identify disproportionate AUs until January 2008 and is initiating 
the process to review the policies, procedures and practices in these AUs. This process will 
be completed by J une 1, 2008. 

Description of Colorado's Review Process 

Colorado's process entails collaboration with targeted AUs to review their policies, 
procedures and practices: 

• The review of written policies includes: (1) an examination of the AU's Board Policies 
which, for Boards of Cooperative Educational Services (BOCES), may include review 
of the School Board Policies of each of the BOCES' constituent school districts; and 
(2) a desk audit of the special education comprehensive plan that all AUs must 
submit to CDE. 

• To evaluate procedures, CDE staff engages with the AU to examine various special 
education documents, including but not limited to the Procedural Flandbook/Manual 
for the AU, the schedule and topics for professional development, and the Specific 
Learning Disability criteria implementation plan (using a Response to Intervention 
model) that must be submitted to CDE by 8/15/08 per state special education 
regulation. 

If an on-site visit is necessary, CDE use the visit to observe the AU's practices related to 
special education eligibility. Activities to be engaged in during an on-site visit include direct 
observation of intervention team, referral team, and eligibility team meetings. Other 
activities may include direct interviews or focus group interviews of various stakeholder 
groups such as parents, general education teachers, special education teachers. 



Overview of I ssue/ Description of System or Process 

Colorado has been looking at issues related to disproportionality for many years as part 
of the CIMP process (see Indicator 15) and Annual Performance Profiles provided to 
Administrative Units on a yearly basis. Currently, Colorado calculates, for each 
Administrative Unit, the extent to which the total minority population in special 
education varies from that Unit’s minority population in general education. 
Administrative Units that have 20% or higher minority representation in special 
education as compared to that Unit's general education population are flagged for 
disproportionality. Colorado also calculates, for each Administrative Unit, disproportional 
representation within five categories of special education disability: Preschool with 
Disability, SLIC (Mental Retardation), SI ED (ED), P/C (LD) and Speech/Language. This 
calculation examines the difference between an individual Unit's minority representation 
within each disability category and compares it to the total minority population in that 
AU. If the difference in any of these 5 disability categories is greater than 20% of that 
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Unit's minority representation within the total education population, the Unit is also 
flagged for disproportionality. 

While the CDE plans on continuing to examine disproportionality using the methods 
described above, Colorado also intends to begin use of the electronic spreadsheet 
provided by Westat to more thoroughly analyze ethnicity by disability data to better 
identify Administrative Units at risk of significant disproportionality that is a result of 
inappropriate identification. The results from the Westat tools will be examined in 
tandem with other assessments to address the extent to which multiple data sources 
converge on indications of disproportionality. Colorado also intends to consider other 
methods to assess disproportionality as a result of stakeholder input. It is anticipated 
that all tools will be folded into the CIMP process (see the overview of cross-cutting 
initiative on page 5 and indicator description of Indicator 15). 

February 2007 Update : In FY2005, Colorado examined a number of different tools to 
define "disproportionate representation". Most AUs in Colorado have quite small 
individual cell sample sizes when data is broken out by each ethnicity and the five 
primary disability categories used in Colorado’s calculation. Therefore, the CDE will 
continue to use "Total Minority" rather than attempting to use specific races/ ethnicities 
when flagging Units for disproportionate representation. Also, the CDE has decided that 
it will continue to use the +/- 20% cut-off as described above for defining significant 
disproportionate representation within individual AUs. The CDE also requires a minimum 
individual cell sample size of 15 to consider exceeding +/- 20% of an AUs total 
education population as a reliable indication of significant disproportionality. 

While the primary trigger for an AU to be flagged for disproportionality is the +/- 20% 
cut-off, the CDE also examines minority representation as a function of the proportion of 
an AU's total education population that is considered minority. This calculation is 
conducted by taking a Unit’s percent of the total education population and multiplying it 
by 0.2. This result is then added to the total minority percentage to define an "Upper 
Bound" and also subtracted from the total minority percentage to form a "Lower Bound." 
If a unit’s minority SPED population or minority population within the 5 SPED categories 
is outside of these bounds, the CDE conducts a more comprehensive assessment of the 
Unit's race/ ethnicity data to determine if there is evidence of significant disproportionate 
representation. While it is believed that this second method will rarely flag additional 
units as having disproportionate representation, it is useful for choosing which AUs 
race/ ethnicity data warrants additional scrutiny. Also, because this second analytic 
method is shared with each AU every year, it is an important tool to allow Units to track 
their race/ ethnicity trends over time and make appropriate adjustments in their own 
policies and procedures before they result in being designated by the CDE as having 
significant disproportionate representation. 

The CDE continues to also work with disproportionality within the Continuous 
Improvement Monitoring Process, and as that system is updated in FY2006, additional 
tools and methods may be brought to bear to address this issue. 

However, once an AU is flagged for significant disproportionality using either method 
and the data is verified, the CDE will conduct a thorough analysis of the AU's data by 
individual race/ ethnicity as well as all disability categories present at the AU. If the 
additional analytic work continues to point to a potential problem with disproportionality 
at the AU, the CDE will begin a drill-down on that Unit's policies and procedures to 
determine whether the results are due to inappropriate identification. A Unit's 
performance with regard to disproportionality as a result of inappropriate identification 
can also trigger a focused monitoring visit and ultimately a citation and sanctions if the 
citation is not corrected within the one-year timeline. 
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The CDE will continue to monitor the effectiveness of these systems to address 
disproportionality and will refine and/or bring in additional tools as needed as 
appropriate. 



Preliminary Baseline Data for FFY 2005 (2005-2006) 

Actual Target Data for FFY 2005: Actual target data for FFY 2005 is pending results of 
review of policies, procedures and, if necessary, practices for the 8 (14%) AUs that met 
the definition for disproportionate representation in special education and related 
services. For the 8 AUs having disproportionate representation based on FFY 2005 data, 
CDE will conduct the required review of policies and procedures to determine whether 
the disproportionate representation is due to inappropriate identification by June 30, 
2008. 



The 8 AUs that met the definition for disproportionate representation did so for the 
following reasons: 

• AU #1: Over- representation of Whites under Method 1 

• AU #2: Over- representation of Asians/Pacific Islanders under Method 2; under- 
representation of Flispanics under Method 1; and over- representation of Whites 
under Method 2 



AU 


#3: 


AU 


#4: 


AU 


#5: 


AU 


#6: 


AU 


# 7 


AU 


#8: 



Over- representation of Blacks under Method 2 
Over- representation of Asians/Pacific Islanders under Method 2 
Over- representation of Whites under Method 1 
Under-representation of Asians under Method 2 
Over- representation of Flispanics under Method 2 
Over- representation of Flispanics under Method 1 



1.8% = 1 AU with disproportionate representation of racial and ethnic groups in special 
education divided by 57 of AU in the State times 100. This Unit’s data shows under- 
representation of minorities in their SPED population of 20.4% 



Discussion of Baseline Data 

The figure on the next page shows the distribution of Colorado’s 57 AUs with respect to 
the difference between minority representation in SPED as compared to minority 
representation in total education. Specifically, the calculation of the X axis is done by 
taking the percent minority in SPED and subtracting the percent minority in total 
education. As shown in the figure, the bulk of Colorado's AUs show very little difference 
in minority percentages in SPED versus total population, and all but 3 are within +/- 
10% points. The district flagged for disproportionate under-representation is shown as 
the short bar on the very left. The two vertical lines in the histogram represent the 
upper and lower cut-off for defining disproportionate representation. 

The CDE is currently conducting additional analyses by race/ ethnicity for the one AU that 
has reported disproportionate under- representation and will work with the AU 
administration on determining whether this was due to inappropriate identification in the 
spring of 2007. 
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Minority Representation in SPED vs Minority Representation in Total 

Education 




Mean =-0.0136 
Std. Dev. =0.04813 
N =57 



[(% Minority SPED) - (% Minority Total ED)] 

Overall, disproportionality does not appear to a major issue in Colorado. The AUs 
flagged in FY2005 for either Indicator 9 or Indicator 10 were for under- representation 
rather than over-representation, the latter of which is arguably the more pressing 
problem nationally. While one might argue that Colorado's lack of apparent 
disproportionality is driven by a large number of AUs with small minority populations, 
this does not appear to be the case. As part of the analytic work for Indicators 9 and 
10, the CDE specifically scrutinized data from Colorado's largest Alls as well as medium 
to large Alls that have large Hispanic populations. This analysis showed that almost all 
comparisons to the total education population in that Unit were well under the +/- 20% 
threshold with most comparisons coming in under +/- 10%. 
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FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 


o% 


2006 

(2006-2007) 


o% 


2007 

(2007-2008) 


o% 


2008 

(2008-2009) 


o% 


2009 

(2009-2010) 


o% 


2010 

(2010-2011) 


o% 



I improvement Activities/ Timelines/ Resources 



In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


1. Determine definition of 
disproportionate 
representation. 


FFY 2006 


Definition is available in this 
document . 




c 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 










o= 


Ongoing 


f 








C= Complete; 








R= 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


2. Collaborate with 


FFY 2007 


It was determined that not 


O 








stakeholder groups and 




enough tools were available to 










Special Education 




address disproportional 










Directors to assess and 




representation. 










revise the 

disproportionality tools 
for Colorado AUs. 




Tools developed and 
implemented. 










3. Require identified 


FFY 2006 


CDE completes the review in 


0 








agencies to complete the 


FFY 2007 


collaboration with AUs. 










revised 

disproportionality 
analysis tools and 
submit to CDE. 


FFY 2008 
FFY 2009 
FFY 2010 


AUs are identified now with 
reports embedded in the 618 
collection. 










4. 1 dentify AUs that 


FFY 2008 


Trend data now exist that AUs 


0 








continue to show a high 


FFY 2009 


with consistent disproportionate 










level of disproportionate 


representation are being 










representation and 
collaborate on the 
development of a 
remediation action plan. 


FFY 2010 


identified. 

When citations for non- 
compliance are warranted, the 
AU is required to submit a 










corrective action plan and 
correct the issue. 


5. Compute baseline and 


FFY 2007 


This has now been completed 




c 






targets for the FFY 2006 
APR due February 1, 
2007. 




and data are available above. 











Resources Used to Support activities 

• I indicator 9/10 team 

• General Supervision team 

• Special Education Directors 

• Data and Research Unit 

• Information Management Systems staff 
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Revisions for FFY 2007 

The CDE is revising and/or adding improvement activities to better reflect current practices. 
Improvement activities are being added to continue through FFY 2010. 



Revised I mprovement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. Identify agencies with 
disproportionate 
representation and 
collaborate with Alls to 
identify root causes of 
disproportionate 
representation and provide 
technical assistance to 
improve practice. 


Apply formula to 618 data. 

Embed formula into 618 data 
collection to alert Alls upon 
data submission of 
disproportionate 
representation. 

1 mplement tools for drill 
down. 

Identify resources to improve 
practice. 

Review implementation of 
corrective action . 


FFY 2006 
FFY 2007 
FFY 2008 
FFY 2009 
FFY 2010 


Indicator 9/10 
team 

1 nformation 
Management 
Systems Unit 

Data and 
Research Unit 

General 

Supervision 

team 


2. Incorporate requirements 
related to disproportionate 
representation in AU 
comprehensive plans to be 
submitted to the CDE. 


Develop Comprehensive Plan 
template 

Train on Comprehensive Plan 
development. 


FFY 2008 
FFY 2009 


General 

Supervision 

team 


3. Expand Rtl tools and 
website. 


Add materials for English 
Language Learners, students 
in poverty, cultural 
sensitivity. 


FFY 2008 
FFY 2009 


Rtl Team 

English 
Language 
Learners with 
Exceptional 
Needs (ELLEN) 
team 


4. Develop protocols for 
students living in poverty. 


Develop standard protocols 
to be used in Rtl and the 
universal tier to help address 
instruction for children living 
in poverty. 


FFY 2009 


Rtl team 
ELLEN team 


5. Collaborate with Title 1, 
ELA and Title 1 1 1 units 
within CDE to provide 
technical assistance. 


Determine key projects that 
can address concerns 
surrounding disproportionate 
representation. 


FFY 2009 


ELLEN team 



Part B State Performance Plan: 2005-2010 
(OMB NO: 1820-0624 / Expiration Date: 2/29/2012) 



Page 93 of 176 





SPP Template - Part B (3) 



Colorado 



Part B State Performance Plan (SPP) for 2005-2010 

Monitoring Priority: Disproportionality 

Indicator 10: Percent of districts with disproportionate representation of racial and ethnic 
groups in specific disability categories that is the result of inappropriate identification. 

(20 U.S.C. 1416(a)(3)(C)) 



Measurement: 

Percent = # of districts with disproportionate representation of racial and ethnic groups in 
specific disability categories that is the result of inappropriate identification divided by # of 
districts in the State times 100. 

Include State's definition of "disproportionate representation." 

Describe how the State determined that disproportionate representation of racial and ethnic 
groups in specific disability categories was the result of inappropriate identification, e.g., 
monitoring data, review of policies, practices and procedures under 618(d), etc. 

February 2008 Update 

State's definition of "disproportionate representation." 

As a result of OSEP's response to Colorado's FFY 2005 SPP/APR, two methods were 
developed between the Fall of 2007 and January 2008 to define "disproportionate 
representation". The methods for Indicator 10 are similar to those described under 
Indicator 9, except that 25 comparisons are conducted under each method for each AU 
rather than the 5 for Indicator 9. The 25 cells are the result of examining 5 disability 
categories by 5 race/ ethnic categories. Also, the underlying approach to Indicator 10 is 
comparing the AU's prevalence of the 5 disability categories within each of the 5 
race/ ethnicity categories to the All's prevalence of the 5 disability categories for the total 
SPED population, regardless of race/ ethnicity. The cut points used for Indicator 10 are the 
same as those used for Indicator 9. 

Both methods examine each of 5 race/ ethnicity categories: 

6) American I ndian or Alaskan Native 

7) Asian or Pacific Islander 

8) Black (not Hispanic) 

9) Hispanic 

10) White (not Hispanic) 

Both methods also examine each of five required disability categories (Colorado does not 
use the category "other health impairments" category): 

1) Mental Retardation 

2) Emotional Disturbance 

3) Specific Learning Disabilities 
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4) Speech or Language I mpairments 

5) Autism 

Method 1: This method examines every Administrative Unit’s (AU) percent of SPED 

students in five disability categories within each race/ ethnicity and compares these 
percentages to the percent of the AU's overall SPED population in each of the five disability 
categories. A cell size of at least 30 special education students within any given 
race/ ethnicity and disability category was set as the minimum to perform a comparison. 
Disproportionate over- representation is defined as a discrepancy of 10 or more percentage 
points between a disability category within race/ ethnicity and a disability category 
independent of race/ ethnicity while under- representation is defined as a discrepancy of 15 
or more percentage points. 

Method 2: This method examines every AU's percent of all SPED students in the five 

disability categories and sets upper and lower bounds. The upper bound for the disability 
categories within each AU is computed by taking the total SPED percentages and multiplying 
each by 0.4 and then adding this result to the original percentages. Similarly, the lower 
bounds for the five disability categories in each AU is computed by taking the total SPED 
student percentages and multiplying by 0.5 and then subtracting this result from the 
original percentages. See the following table for an example. 



An Example 


of Setting 


Upper and Lower Bounds 


for an AU's 


Overall 


SPED 


Population 


Mental 

Retardation 


Emotional 

Disturbance 


Specific 

Learning 

Disability 


Speech or 
Language 
1 mpairment 


Autism 




Percent 1 n 
Total SPED 
Population 


5% 


10% 


36% 


25% 


3% 




Calculation 
for Upper 
Bound 


(5 X .4) + 5 


(10 X .4) + 
10 


(36 X .4) + 
36 


(25 X .4) + 
25 


(3 X .4) 
3 


+ 


Upper 

Bound 

Result 


7% 


14% 


50.4% 


35% 


4.2% 




Calculation 
for Lower 
Bound 


5 - (5 X .5) 


10 - (10 X 
.5) 


36 - (36 X 
.5) 


25 - (25 X 
.5) 


3 - (3 

.5) 


X 


Lower 

Bound 

Result 


2.5% 


5% 


18% 


12.5% 


1.5% 





Upper and lower bounds are set for the five disability categories for every AU. If an AU's 
percent in a disability category within any given race/ethnicity exceeds the upper bound, 
the AU meets the definition of disproportionate over-representation. If an AU's percent in a 
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disability category within any given race/ ethnicity is below the lower bound, the Alls meet 
the definition for disproportionate under-representation. A cell size of at least 30 special 
education students in any given disability category within each race/ ethnicity category was 
set as the minimum to perform a comparison. Additionally, a difference of at least +/- 2% 
under Method 1 was set as a minimum before any result under Method 2 would meet the 
definition of disproportionate representation. 

Overall, disproportionate representation in an AU for Indicator 10 is defined as having a 
discrepancy in disability prevalence between any of the 5 races/ethnicities and that All's 
overall prevalence among the SPED population (regardless of race) under the thresholds set 
in either Method 1 or Method 2. 

Describe how the State determined that disproportionate representation of racial 
and ethnic groups in special education and related services was the result of 
inappropriate identification, e.g., monitoring data, review of policies, practices and 
procedures under 618 (d), etc. 

As described under Indicator 9, given the timing of Colorado's FFY 2006 Student Count and 
the need to develop a definition of disproportionality based on every race/ ethnicity category 
rather than using "total minority", the State did not identify disproportionate Alls until 
January 2008 and is initiating in the process to review policies, practices and procedures in 
these Alls. This process will be completed by J une 1, 2008. 

Given the timing of Colorado’s FFY 2006 Student Count and the need to develop a definition 
of disproportionality based on every race/ ethnicity category rather than using "total 
minority", the State did not identify disproportionate Alls until January 2008 and is initiating 
the process to review the policies, procedures and practices in these Alls. This process will 
be completed by J une 1, 2008. 

Description of Colorado's Review Process 

Colorado’s process entails collaboration with targeted Alls to review their policies, 
procedures and practices: 

• The review of written policies includes: (1) an examination of the All's Board Policies 
which, for Boards of Cooperative Educational Services (BOCES), may include review 
of the School Board Policies of each of the BOCES' constituent school districts; and 
(2) a desk audit of the special education comprehensive plan that all Alls must 
submit to CDE. 

• To evaluate procedures, CDE staff engages with the AU to examine various special 
education documents, including but not limited to the Procedural Handbook/Manual 
for the AU, the schedule and topics for professional development, and the Specific 
Learning Disability criteria implementation plan (using a Response to Intervention 
model) that must be submitted to CDE by 8/15/08 per state special education 
regulation. 

If an on-site visit is necessary, CDE use the visit to observe the AU's practices related to 
special education eligibility. Activities to be engaged in during an on-site visit include direct 
observation of intervention team, referral team, and eligibility team meetings. Other 
activities may include direct interviews or focus group interviews of various stakeholder 
groups such as parents, general education teachers, special education teachers. 
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Overview of issue/ Description of System or Process 

As discussed under Indicator 9, in FY2005, Colorado examined a number of different 
tools to define "disproportionate representation". Most AUs in Colorado have quite small 
individual cell sample sizes when data is broken out by each ethnicity and the five 
primary disability categories used in Colorado’s calculation (Preschool with Disability, 
SLIC (Mental Retardation), SI ED (ED), P/C (LD) and Speech/Language). Therefore, the 
CDE will use "Total Minority" rather than attempting to use specific races/ ethnicities 
when flagging Units for disproportionate representation. The specific calculation for 
flagging significant disproportionate representation examines the difference between an 
individual Unit's minority representation within each of the 5 disability category and 
compares it to the total minority population in that AU. If the difference in any of these 
5 disability categories is greater than 20% of that Unit’s minority representation within 
the total education population, the Unit is also flagged for significant disproportionality. 
The CDE also requires a minimum individual cell sample size of 15 in any of the disability 
categories to consider exceeding +/- 20% of an AUs total education population as a 
reliable indication of significant disproportionality. 

While the primary trigger for an AU to be flagged for significant disproportionality is the 
+/- 20% cut-off, the CDE also examines minority representation as a function of the 
proportion of an AU's total education population that is considered minority. This 
calculation is conducted by taking a Unit’s percent of the total education population and 
multiplying it by 0.2. This result is then added to the total minority percentage to define 
an "Upper Bound” and also subtracted from the total minority percentage to forma a 
"Lower Bound.” If a unit's minority population within any one of the 5 SPED categories 
is outside of these bounds, the CDE conducts a more comprehensive assessment of the 
Unit's race/ ethnicity data to determine if there is evidence of disproportionate 
representation. While it is believed that this second method will rarely flag additional 
units as having significant disproportionate representation, it is useful for choosing which 
AUs race/ethnicity data warrants additional scrutiny. Also, because this second analytic 
method is shared with each AU every year, it is an important tool to allow Units to track 
their race/ ethnicity trends over time and make appropriate adjustments in their own 
policies and procedures before they result in being designated by the CDE as having 
significant disproportionate representation. 

The CDE continues to also work with disproportionality within the Continuous 
Improvement Monitoring Process, and as that system is updated in FY2006, additional 
tools and methods may be brought to bear to address this issue. 

Flowever, once an AU is flagged for significant disproportionality using either method 
and the data is verified, the CDE will conduct a thorough analysis of the AU's data by 
individual race/ ethnicity as well as all disability categories present at the AU. If the 
additional analytic work continues to point to a potential problem with significant 
disproportionality at the AU, the CDE will begin a drill-down on that Unit’s policies and 
procedures to determine whether the results are due to inappropriate identification. A 
Unit's performance with regard to disproportionality as a result of inappropriate 
identification can also trigger a focused monitoring visit and ultimately a citation and 
sanctions if the citation is not corrected within the one-year timeline. 

The CDE will continue to monitor the effectiveness of these systems to address 
disproportionality and will refine and/or bring in additional tools as needed as 
appropriate. 
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Baseline Data for FFY 2004 (2004-2005) 

3.5% = 2 of AUs with disproportionate representation of racial and ethnic groups in 
specific disability categories divided by 57 of Alls in the State times 100. A total of 4 
Units were originally flagged for disproportionality by disability category. However, 
additional analyses conducted, showed that disproportionality was not apparent for two 
AUs when the percent SPED minority within each of the 5 disability categories was 
compared to the percent SPED non-minority within each of the same categories. The 
apparent disproportionality in the other two AUs remained after conducting the 
additional analytic work. 

Discussion of Baseline Data 

One AU reached the definition of disproportionate representation for under- 
representation in SI ED (ED) and nearly meets the definition for under- representation of 
PC(LD), and Preschool with disability. 

The second AU reached the definition of disproportionate representation for under- 
representation in SI ED (ED). 

The CDE is currently conducting additional analyses by race/ ethnicity for these two AUs 
and will work with the AU administrations on determining whether these were due to 
inappropriate identification in the spring of 2007. 

Nine additional AUs met the threshold of +/- 20 discrepancy from the percent minority 
for total education population, but did not meet the minimum cell size requirements for 
the discrepant disability categories. 

Overall, disproportionality does not appear to a major issue in Colorado. The AUs 
flagged in FY2005 were for under- representation rather than over- representation, the 
latter of which is arguably the more pressing problem nationally. While one might argue 
that Colorado’s lack of apparent disproportionality is driven by a large number of AUs 
with small minority populations, this does not appear to be the case. As part of the 
analytic work for Indicators 9 and 10, the CDE specifically scrutinized data from 
Colorado's largest AUs as well as medium to large AUs that have large Hispanic 
populations. This analysis showed that almost all comparisons to the total education 
population in that Unit were well under the +/- 20% threshold with most comparisons 
coming in under +/- 10%. 



FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 


o% 


2006 

(2006-2007) 


o% 


2007 

(2007-2008) 


o% 
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FFY 


Measurable and Rigorous Target 


2008 

(2008-2009) 


o% 


2009 

(2009-2010) 


o% 


2010 

(2010-2011) 


o% 



I mprovement Activities/ Timelines/ Resources: 

In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


1. Determine definition of 
disproportionate 
representation. 


FFY 2006 


Definition is available in this 
document. 




c 






2. Collaborate with 

stakeholder groups and 
Special Education 
Directors to assess and 
add or adjust, as 
needed, the 
disproportionality tools 
for Colorado AUs. 


FFY 2007 


It was determined that not 
enough tools were available to 
address disproportionate 
representation. 

Tools developed. 


O 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 










o= 


Ongoing 


f 








C= Complete; 








R= 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


3. Require identified 


FFY 2006 


CDE still completes the review. 


O 








agencies to complete the 
revised 

disproportionality 


FFY 2007 


AUs are identified now with 










FFY 2008 


reports embedded in the 618 
collection. 










analysis tools and 
submit to CDE. 


FFY 2009 














FFY 2010 












4. Identify those agencies 


FFY 2008 


Enough trend data now exist 


0 








that continue to show a 


FFY 2009 


that AUs with consistent issues 










high level of 


are being identified. 










inappropriate 
identification and 
collaborate on the 
development of a 
remediation action plan. 


FFY 2010 


When citations for non- 
compliance are warranted, the 
AU is required to submit a 
corrective action plan and 
correct the issue. 










5. Compute baseline and 


FFY 2007 


This has now been completed 




c 






targets for the FFY 2006 
APR due February 1, 
2007. 




and data are available above. 











Resources Used to Support Activities 

• I ndicator 9/10 team 

• General Supervision team 

• Special Education Directors 

• CDE Data and Research Unit 

• CDE Information Management Systems staff 
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Revisions for FFY 2008 

The CDE is revising and/or adding improvement activities to better reflect current practices. 
Improvement activities are being added to continue through FFY 2010. 



Revised I mprovement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. Identify agencies with 
disproportionate 
representation and 
collaborate with Alls to 
identify root causes of 
disproportionate 
representation and provide 
technical assistance to 
improve practice. 


Apply formula to 618 data. 

Embed formula into 618 data 
collection to alert Alls upon 
data submission of 
disproportionate 
representation. 

Implement tools for drill down. 

Identify resources to improve 
practice. 

Review implementation of 
corrective action. 


FFY 2006 
FFY 2007 
FFY 2008 
FFY 2009 
FFY 2010 


1 ndicator 
9/10 team 

1 nformation 
Management 
Systems Unit 

Data and 
Research Unit 

General 

Supervision 

team 


2. 1 ncorporate requirements 
related to disproportionate 
representation in for AU 
comprehensive plans to be 
submitted to the CDE. 


Develop Comprehensive Plan 
template. 

Train on Comprehensive Plan 
development. 


FFY 2008 
FFY 2009 


General 

Supervision 

team 


3. Expand Rtl tools and website. 


Add materials for English 
Language Learners, students 
in poverty, cultural sensitivity. 


FFY 2008 
FFY 2009 


Rtl Team 
ELLEN team 


4. Develop protocols for 

instruction for students living 
in poverty. 


Develop standard protocols to 
be used in Rtl and the 
universal tier to help address 
the instruction for children 
living in poverty. 


FFY 2009 


Rtl team 
ELLEN team 


5. Collaborate with Title 1, ELA 
and Title 1 1 1 units within CDE 
to provide technical 
assistance. 


Determine key projects that 
can help address concerns 
surrounding disproportionate 
representation. 


FFY 2009 


ELLEN team 
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Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: Effective General Supervision Part B / Child Find 

For FFY 2008 the measurement for Indicator 11 was changed. The Indicator now reads: 

I ndicator 11: Percent of children who were evaluated within 60 days of receiving parental 
consent for initial evaluation or, if the State establishes a timeframe within which the 
evaluation must be conducted, within that timeframe. 

(20 U.S.C. 1416(a)(3)(B)) 



Measurement: 

a. # of children for whom parental consent to evaluate was received. 

b. # of children whose evaluations were completed within 60 days (or State-established 
timeline). 

Account for children included in a but not included in b. Indicate the range of days beyond 
the timeline when the evaluation was completed and any reasons for the delays. 

Percent = [(b) divided by (a)] times 100. 



Measurement: 

a. 208 of children for whom parental consent to evaluate was received. 

b. Unknown # determined not eligible whose evaluations and eligibility determinations 
were completed within 60 days (or State established timeline). 

c. 176 determined eligible whose evaluations and eligibility determinations were 
completed within 60 days (or State established timeline = 45 school days). 

Account for children included in a but not included in b or c: Appropriate extensions of the 
timeline due to extenuating circumstances, incomplete information in the student file, 
discrepancy between initiation of the I EP and the signature date, and the determination 
process being started just prior to summer break and not being completed until after the 
summer break. The number of days in excess of the 45-day timeline is not typically 
collected during the SRR process. 

84.6% = 176 + 0 divided by 208 times 100. 



Overview of I ssue/ Description of System or Process 

For information on the selection of Administrative Units for monitoring, see Indicator 15. 

Colorado has had a requirement for evaluation timelines for some time. The timeline is 
45 school days from consent for the collection of additional data to the determination of 
eligibility. If there are extenuating circumstances and both the Administrative Unit and 
parent agree, the timeline can be extended in order to ensure appropriate and sufficient 
information has been collected. Through Colorado's CIMP, a random selection of files is 
reviewed every year. This timeline is one factor that is examined for each file. If an 
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Administrative Unit has a problem meeting this 45 day timeline, they are cited as out of 
compliance and must correct the problem within 1 year. This system for gathering this 
data is already in place in Colorado. However, the Colorado data collection system via 
monitoring collects data on both initial and reevaluations and is based on the review of 
files of children found eligible for special education services. 

February 2007 Update: Colorado continues to collect compliance with the 45-day 

timeline within the CIMP process using the Student Record Review process. Because 
this process entails the review of files for students who were found eligible for services, 
Colorado does not have data on component "b" of the measurement: the # determined 
not eligible whose evaluations and eligibility determinations were completed within 45 
days. By fall of 2007, the CDE intends to include data collection for all pieces of this 
indicator as part of its redesign of the End-of-Year report. Data from the new system on 
this indicator will be available for Colorado's FFY2007 Annual Performance Report. This 
will allow the CDE to base the results on the basis of census data rather than drawing a 
yearly representative sample. Targets will be adjusted accordingly at that time. In the 
interim, the CDE will continue to use the SRR for reporting on performance with regard 
to the 45 day timeline for 1 more year. 

February 2010 Update: Colorado's updated Rules (for the) Administration of the 
Exceptional Children's Educational Act ( Rules ) went into effect December 30, 2007. 
These Rules provided better alignment with the Federal Regulations for the Individuals 
with Disabilities Education Improvement Act of 2004. This Rules change now requires 
that initial evaluations are completed within 60 calendar days of the AU/SOP receiving 
written consent from the parent(s). Data for this indicator are collected on the Special 
Education End of Year data collection. 

Baseline Data for FFY 2005 (2005-2006) 

84.6% 

Discussion of Baseline Data 

In FY2005, 1,060 files from nine AUs were reviewed. 208 of these files reviewed Initial 
IEP meetings where parental consent to evaluate was received. 



FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 


100% 


2006 

(2006-2007) 


100% 


2007 

(2007-2008) 


100% 


2008 

(2008-2009) 


100% 
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FFY 


Measurable and Rigorous Target 


2009 

(2009-2010) 


100% 


2010 

(2010-2011) 


100% 



I mprovement Activities/ Timelines/ Resources: 

In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 










o= 


Ongoing; 








C=Complete; 








R= 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


1. Collect data on reasons for 


FFY 2006 


Reasons for delay are 


O 








delays in evaluation 


FFY 2007 


coded in end of year 










timeline. 


(EOY) data collection; 












FFY 2008 


data analysis conducted 












FFY 2009 


by CDE in collaboration 
with AU. 












FFY 2010 












2. Communicate to AUs that 


FFY 2006 


Training provided to AU 




c 






summer break is not an 
acceptable delay of the 
evaluation timeline. 




Directors. 










3. Add 1 ndicator 11 data 


FFY 2006 


1 ndicator 11 data 




c 






collection elements to the 




elements were added to 










ESLU's EOY student data 




EOY student data 










collection system. 




collection. 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 










o= 


Ongoing 


9 








C=Complete; 








R = 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


4. Provide technical assistance 


FFY 2006 


Training incorporated into 


O 








on the evaluation timeline 
during the End-of-Year 


FFY 2007 


process as described. 










Training Process. 


FFY 2008 














FFY 2009 














FFY 2010 












5. Utilize AU level data in the 


FFY 2006 


Annual Determinations 


0 








annual local determination 


FFY 2007 


included 1 ndicator 11 










process and report in the 


data; public reports are 










individual AU public 


FFY 2008 


available on the CDE 










reports. 


FFY 2009 


website at 

htto: //www. cde. state. co. 
us/cdesoed/AUoerforman 
ceorofiles.asD. 














6. Build a reporting process 


FFY 2006 


ESLU collaborates with 


0 








that calculates and displays 


FFY 2007 


DSU and IMS to review 










each AU's compliance rate 


and revise reports that AU 










with the evaluation timeline 


FFY 2008 


Special Education 










at the time of the AU's 


FFY 2009 


Directors review prior to 










submission. 


final approval of data. 












FFY 2010 


Special Education 
Directors sign and submit 
reports that verify the 
validity and reliability of 
data. 










7. Develop procedures 


FFY 2007 


Protocols developed and 




c 






developed based on IDEA, 




Directors trained during 










ECEA and OSEP's Related 




fall Statewide Directors' 










Requirements document to 
assist AUs to identify root 
causes of delays in timely 
completion of initial 
evaluations. 




Meeting. 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C=Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


8. Review and revise 

allowable reasons for delay. 


FFY 2008 


Reason codes were 
reviewed and only 
allowable reason codes 
are included in the data 
collection. 




c 







Improve review of policies, procedures and practices at the AU level 



Resources Used to Support Activities 

• CDE Rtl team 

• ESLU General Supervision team 

• ESLU Indicator 11 team 

• CDE Data and Research Unit 

Revisions for FFY 2008 

An improvement activity that more accurately reflects current practice has been added and 
is displayed in the following table. 



Revised I mprovement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. Improve review of policies, 


Review and revise Indicator 11 drill- 


FFY 2009 


1 ndicator 11 


procedures and practices 


down materials (current version is 


FFY 2010 


Team 


at the AU level. 


posted at 


General 

Supervision 






httD://www.cde.state.co.us/cdesoed 




Team 




/SPP TraininaMaterials.aso 




AU staff 




Collaborate with AUs to conduct 
review of data and analyze root 
cause(s) for delays in completion of 
initial evaluations. 








Provide training to AUs to engage in 
ongoing evaluation of policies, 
procedures and practices. 
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Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: Effective General Supervision Part B / Effective Transition 

For FFY 2008 the measurement for I ndicator 12 was changed. The I ndicator now reads: 

I ndicator 12: Percent of children referred by Part C prior to age 3, who are found eligible 
for Part B, and who have an IEP developed and implemented by their third birthdays. 

(20 U.S.C. 1416(a)(3)(B)) 



Measurement: 

a. # of children who have been served in Part C and referred to Part B (LEA notified 
pursuant to 637(a)(9)(A)) for Part B eligibility determination. 

b. # of those referred determined to be NOT eligible and whose eligibility was determined 
prior to their third birthdays. 

c. # of those found eligible who have an IEP developed and implemented by their third 
birthdays. 

d. # of children for whom parent refusal to provide consent caused delays in evaluation or 
initial services. 

e. # of children who were referred to Part C less than 90 days before their third birthdays. 

Account for children included in a but not included in b, c, d or e. Indicate the range of 

days beyond the third birthday when eligibility was determined and the IEP developed and 

the reasons for the delays. 

Percent = [(c) divided by (a - b - d - e)] times 100. 



Overview of I ssue/ Description of System or Process 

The early intervention system, including their LEA partners, completed compliance 
requirements under a Federal compliance plan for timely 0-3 transitions June 2005. 
Local early childhood systems (the local Part C coordinator, early intervention CCB 
director, Child Find and LEA personnel at a minimum in each community) all participated 
in a thorough review of transition requirements under IDEA between September 2004- 
November 2004 and submitted a joint analysis of transition processes and compliance 
plan to assure compliance with IDEA transition requirements by June 2005, including 
notification, IFSP planning and timelines. 

Local early childhood systems have refined their transition processes and procedures to 
achieve timely transitions, create plans with all necessary steps and services included, 
notify the LEA so as to enable them to be part of the planning process and documenting 
the process. All local Early Childhood interagency groups have written transition 
agreements which include policy and procedures for timelines, notification, transition 
planning and plans. They are all aware and informed of the requirements for 100% 
compliance targets. 

At the time of this report, Colorado does not have data on Part "c" of this indicator. 
While the CDE is currently able to count the number of students that have an IEP 
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developed by their third birthday, it is not possible to back out the number of newly 
identified children as opposed to children that were served by Part "c". The 
development of SASID tracking numbers for Part "c" students would remediate this 
problem, but a number of challenges exist. Regardless of these challenges, a new 
system for collecting Part "c" will be developed in spring 2006 and will be more fully 
articulated with baseline and targets in our next APR due February 2007. 

Currently, if an Administrative Unit is going through the CIMP process, a stratified 
sample of young children with I EPs is reviewed. If the child was served by Part C 
previously, the timeline for IEP development by the child’s 3 rd birthday is examined and 
if there are problems, they are brought to the attention of the Unit and the Part C 
provider. Unfortunately, for most of the Administrative Units that have gone through 
CIMP, the number of files that have been selected where children did not participate in 
Part C has been so small that the data cannot be used at the state level to utilize in the 
decision making process or to assess trends over time. 

February 2007 Update: The Colorado Department of Education (CDE) Early Childhood 
Special Education staff continues to support LEA personnel as they transition children 
from the birth to three system into public school preschool services. In January 2006, 
the lead agency for Part C of IDEA was changed. CDE formed a partnership in spring 
2006 with the National Early Childhood Transition Center (NECTC), an OSEP funded 
project. CDE staff continued to provide planned training and technical assistance to LEA 
and birth to three agencies through the spring of 2006. 

Support for LEAs from CDE Early Childhood Special Education staff continues through 
on-going technical assistance and a targeted training initiative in partnership with the 
NECTC. In a summer/fall 2006 survey, LEAs indicated a strong, statewide need for 
support in the area of transition practices. Spring and fall 2006 CIMP monitoring (4 
LEAs or Administrative Units) revealed planning and evaluation for eligibility timelines 
were being met, however, IEP review indicated that the transition plan was not always 
individualized or specific. This input helped inform the work of CDE in developing the 
partnership project with the NECTC. 

Baseline Data for FFY 2004 (2004-2005) 

a. 1,659 children were referred to Part B for eligibility determination. 

b. 223 children or 11.6 % of the total referred were determined NOT eligible for Part B. 
There were 69 children or 4.2% for whom eligibility was not established or 
confirmed. 54 children were over the age of 3 years when they transitioned to Part 
B 

c. No data is available detailing the # of Part B eligible children who had an IEP 
developed and implemented by their 3 rd birthday. 

Discussion of Baseline Data 

Baseline data for items "a" and "b" is derived from the Part C Statewide Data Report for 
12.1.04 which utilized local database information. Intensive work was done at the state 
and local level to analyze the state and local issues contributing to non-compliance on 
the transition process. The state developed training and technical assistance materials 
and provided training statewide. Data for Part "c" is not currently collected. A process 
for collecting this information will be implemented in FFY2006. 
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FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 


100% 


2006 

(2006-2007) 


100% 


2007 

(2007-2008) 


100% 


2008 

(2008-2009) 


100% 


2009 

(2009-2010) 


100% 


2010 

(2010-2011) 


100% 



I improvement Activities/ Timelines/ Resources 



In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


1. Conduct critical appraisal 
of current data systems' 
ability to address this 
indicator. 


FFY 2006 


Indicator 12 data elements 
were added to the EOY student 
data collection. 




c 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 










o= 


Ongoing 


f 








C= Complete; 








R = 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


2. Continued training and 


FFY 2007 


Training for data collection and 


O 








technical assistance 


FFY 2008 


interpretation of data results is 










provided by the CDE to 


provided with EOY data training 










AUs. 


FFY 2009 


in eight regions across the 












FFY 2010 


state. 










3. Training and technical 


FFY 2007 


Both lead agencies provide 


O 








assistance from CDE 


FFY 2008 


technical assistance on 










state staff for both Part 
C and Part B local teams 
continue to focus on 


transition on an ongoing basis. 










FFY 2009 
FFY 2010 


compliance with 


State Child Find Responsibilities 










transition and eligibility 




were laid out for Part C and 










timeline requirements. 




Part B agencies and can be 
found at: 














httD:// www.cde.state.co.us/earl 
v/downloads/CHI LDFI ND/DHS- 
CDEI oinCFMemo.pdf. 










4. Convene meetings with 


FFY 2007 


Data systems for Part C and 




c 






Part C and Part B staff to 




Part B are in place to address 










remediate any 
shortcomings identified 
in # 1 above. 




the SPP requirements. 










5. Statewide training for 
child find teams on 
transition compliance 
indicators. 


FFY 2007 
FFY 2008 


The CDE meets with child find 
coordinators and early 
childhood teams twice annually. 

Communication is disseminated 


0 








FFY 2009 




FFY 2010 


via listserve on a monthly 
basis. 














Technical assistance is provided 
by the CDE and Part C as 
requested. 
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Activity 


Timeline 


Results or Progress 




Status* 












* Status 
Notations: 












o= 


Ongoing; 










C= Complete; 










R = 


Revised; 












D = 


Deleted 












O 


C 


R 


D 


6. 


Data collection strategies 


FFY 2006 


Baseline data are available in 




c 








developed to establish 
baseline data for 
measurement "c" - # of 
eligible children with an 
1 EP established and 




the SPP. 












implemented by third 
birthday. 














7. 


Continued data collection 


FFY 2007 


The Indicator 12 team has 


O 










and analysis. 


FFY 2008 


developed self-assessment 
tools to determine root causes 














FFY 2009 


of delay. 














FFY 2010 


Training was provided to all AU 
Special Education Directors at 
meeting in fall 2008. 
















The Indicator 12 team conducts 
reviews of data for AUs. 










8. 


Implement additional 


FFY 2008 


The clarification of IEP 




c 








data collection 




implementation date will be 












mechanisms. 




corrected with FFY 2008 EOY 
student collection. 










9. 


Collected data on 


FFY 2007 


This element has been added to 


O 










reasons for delays in 


FFY 2008 


the EOY student data collection. 












Part C to Part B 
transitions. 


FFY 2009 


Technical assistance is provided 
for AUs using the data on 














FFY 2010 


reasons to help identify root 
causes of delays. 










10 


1 ncluded AU level 


FFY 2006 


Annual Determinations included 


0 










Indicator 12 data in the 


FFY 2007 


Indicator 12 data; public 












annual determination 


reports are available on the 












process and in public 


FFY 2008 


CDE website at 












reports. 


FFY 2009 


httD:// www. cde. state, co. us/cde 
soed/AUoerformanceorofiles.as 














FFY 2010 


fi- 











Part B State Performance Plan: 2005-2010 
(OMB NO: 1820-0624 / Expiration Date: 2/29/2012) 



Page 111 of 176 



SPP Template - Part B (3) 



Colorado 



Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


11. Built a reporting process 
that calculates and 
displays each All's 
compliance rate with the 
evaluation timeline at 
the time of the All's 
submission. 


FFY 2006 
FFY 2007 
FFY 2008 
FFY 2009 


Reports are produced when 
data collection closes; All 
Directors sign report assuring 
validity and reliability of data. 


O 








12. Disseminate research 
based transition 
practices to Part C and 
Part B systems. 


FFY 2008 


Link to the National Early 
Childhood Transition Center is 
posted on the CDE Early 
Childhood Special Education 
website Transition page with 
specific transition-based 
transition practices: 

htto:// www. hdi.ukv.edu/NECTC 
/Plome.asDX. 

This information, along with 
other technical assistance 
documents, was disseminated 
via monthly early childhood 
electronic resources, statewide 
conference calls between both 
Part C and Part B (preschool) 
systems, and through CDE's 
official electronic weekly 
updates for school districts. 




c 
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Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


C 


R 


D 


13. Provide training to PEAK 
Parent Mentors on early 
transitions. 


FFY 2008 


Trained PEAK Parent Mentors 
and school district Child Find 
coordinators on Transition 
practices modules developed by 
the CDE. 

The modules are posted on the 
CDE Early Childhood website. 

PowerPoint for Earlv 
Intervention to Part B 
Transitions 

Guidelines for Transition from 
Earlv Intervention (Part C) to 
Preschool (Part B) 










14. Revise EOY data 
collection to capture 
date that 1 EP is 
implemented. 


FFY 2008 


AUs were required to provide 
actual implementation dates in 
the collection for the 2008- 
2009 school year. 




c 







Resources Used to Support Activities 

• CDE Early Childhood Education Team 

• ESLU General Supervision team 

• ESLU I ndicator 12 team 

• CDE Data and Research Unit 
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Revisions for FFY 2008 

An improvement activity is being added to reflect current practice and to continue through 
FFY 2010. 



Revised I mprovement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. Early Childhood Transition 
statewide conference (to 
include Part C, preschool 
and kindergarten 
personnel). 


Identify content for, develop 
and conduct Early Childhood 
Transition conference. 


J une 2009 


CDE Early 
Childhood 
staff 

Other 

partners as 
appropriate 
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Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: Effective General Supervision Part B / Effective Transition 



Indicator 13: Percent of youth aged 16 and above with an IEP that includes coordinated, 
measurable, annual IEP goals and transition services that will reasonably enable the student 
to meet the post-secondary goals. 

(20 U.S.C. 1416(a)(3)(B)) 



Measurement: 

Percent = # of youth with disabilities aged 16 and above with an IEP that includes 
coordinated, measurable, annual IEP goals and transition services that will reasonably 
enable the student to meet the post-secondary goals divided by # of youth with an IEP age 
16 and above times 100. 



Measurement: 

2.1% = 22 youth with disabilities aged 16 and above with an IEP that includes coordinated, 
measurable, annual IEP goals and transition services that will reasonably enable the student 
to meet the post-secondary goals divided by 1,024 youth with an IEP age 16 and above 
times 100. 



Overview of I ssue/ Description of System or Process 

In Colorado we recognize the need for accurate data collection and continuous 
improvement of student outcomes. This data will be collected as part of our Continuous 
Improvement and Monitoring Program (CIMP). Although we have been collecting this 
data through CIMP and the Transition Outcomes Project, (TOPS) we have not used a 
random sampling strategy for the data collection. We will now include sample selection 
for all monitoring activities by stratified random sampling. The stratification is based on 
disability, grade, and school site with an appropriate number of students in the 
mandated transition range included in the sample. We will use the TOPS process as a 
means of providing technical assistance to districts with compliance issue in the areas of 
transition. That data will then be used to determine if districts corrected the concerns in 
one year. 

In order to implement this change we have: 

• Reviewed current systems of data collection used for general education and 
special education federal and state mandates, including moving to an End of Year 
reporting system rather than a December to December reporting system. 

• Analyzed transition data through the Transition Outcomes Project and the 
Continuous Improvement Monitoring Process to determine the connection and 
issue of effective transition planning on students' lEPs. 

• Reviewed current data on student performance for students on lEPs. 



Part B State Performance Plan: 2005-2010 
(OMB NO: 1820-0624 / Expiration Date: 2/29/2012) 



Page 115 of 176 







SPP Template - Part B (3) 



Colorado 



• Worked across units at the Colorado Department of Education to increase 
awareness and integrate efforts. 

• Participated in the NCSET National Transition Summit. 

• Participated in National Drop-out Prevention Center for Students with Disabilities 
telephone seminars and conference calls. 

• Discussed information on transition and post-school outcome data collection with 
the Colorado Special Education Advisory Committee (CSEAC). 

• Worked on building capacity among transition coordinators throughout Colorado's 
eight regions. 

February 2007 Update: In FFY2005, the CDE decided against collecting data for 
Indicator 13 through CDE's CIMP and TOPs systems as described above. It was decided 
that the data collected through these existing systems did not meet the level of rigor 
deemed necessary with respect to this measurement requirements to adequately report 
on this Indicator. Therefore, the ESSU of the CDE contracted with Cutting EdJ which 
utilizes the National Secondary Technical Assistance Center's (NSTTAC) Indicator 13 
checklist approved by OSEP as a rigorous, valid and reliable tool to assess performance 
on this Transitions Planning Indicator (see Exhibit A for Indicator 13 for a copy of the 
review protocol in use and assessment criteria). CDE's Indicator 13 file review team 
received extensive training so that they strictly adhere to the data collection 
methodology and review benchmarks outlined by NSTTAC. Only those lEPs that 
demonstrate compliance with all six elements of the checklist are considered to have 
fully met the requirements of this Indicator. 

As part of the contract with Cutting EdJ, the CDE utilizes all the functionality of the Web- 
based support provided for data entry, assessment and dissemination to participating 
AUs. The standard reporting systems built into the Cutting EdJ Website allows for the 
timely and user-friendly development of AU level results for each item of the NSTTAC 
review checklist as well as total score so that local agencies can readily utilize this 
information in future planning activities. 

Baseline Data for FFY 2005 (2005-2006) 

2.1% of youth with disabilities aged 16 were deemed to have an IEP that includes 
coordinated, measurable, annual IEP goals and transition services that will reasonably 
enable the student to meet the post-secondary goals. 

Discussion of Baseline Data 



FY2005 Sample Characteristics 

A total of 14 AUs from geographically varied areas of the state were included in the 
FFY2005 sample. The AUs sampled also included AUs that varied in size demographic 
composition. The table on the next page provides a comparison on key characteristic 
between the AUs in the sample and state overall. As seen in the table, with the 
exception of somewhat inflated percentages of Hispanic and Total Minority populations, 
the AUs in the sample mirror the state percentages rather well. 

For each AU in the FY2005 sample, a random sample of lEPs for students that were 16 
years old or above were selected for review. For each AU, 15% of these lEPs, with a 
minimum of 50, were randomly selected for a total of 1,024. 
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Characteristic 


AUs in Sample 


State 


% SPED Within Total Education Population 


11.5% 


10.6% 


% ELL Within Total Education Population 


14.8% 


12.8% 


% LD Within SPED Population 


37.5% 


36.5% 


% ED within SPED Population 


10.7% 


10.0% 


% MR within SPED Population 


5.0% 


4.2% 


% Speech/ Language within SPED Population 


22.3% 


24.8 


% All Other Disabilities within SPED 
Population 


24.5% 


24.7% 


% Female 


32.8% 


32.3% 


% Hispanic within SPED Population 


33.3 


26.6% 


% Total Minority within Sped Population 


46.6% 


38% 


% of SPED Population that was 15 years old 
or older. 


24.0% 


23.4% 


% Drop-outs within Total SPED Population 
(Divisor is all SPED Students) 


3.2% 


3% 



Discussion of FY2005 Baseline Data Results 

The Indicator 13 review team (comprised of 2 CDE staff and 7 independent contractors) 
has concluded the following upon completion of the first year of Indicator 13 file review 
data. First, there are some sites that seem to document transition services better than 
others; this typically occurred in rural or small districts, we assume this is a result of 
having fewer teachers to train and thus having stronger cohesiveness within AU 
practices. Second, the review team is certain that many more transition activities and 
services are being provided within schools to students than can be gleaned from the IEP 
documentation alone. Third, some sites evaluated had insufficient forms that would 
prompt the IEP author to include critical data for transition planning such as a section 
dedicated to the Post School Goals, Transition Services, or Transition Assessment. Such 
deficiencies are clearly a major contributor to the lack of transition documentation found 
within lEPs. Fourth, in many cases (approximately 1/3 of lEPs reviewed) a complete 
lack of Post School Goals was present thus indicating an absence of the fundamental 
understanding of IDEA 2004 transition requirements. For a significant portion of lEPs 
that did have Post School Goals (measurable or not), it also was apparent that the 
understanding of the term "coordinated set of activities" was unclear. A vast majority of 
lEPs did not connect all the elements of the checklist and thus led the team to conclude 
that a large gap in the fundamental understanding of transition services and their 
purpose was neglected. Fifth, the team noted that very few lEPs indicated linkages with 
Adult Service agencies, leading the team to be further convinced transition planning has 
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been neglected. Lastly, the team felt that the requirement to measure "if consent was 
provided prior to inviting agencies" was an unfair benchmark and may have contributed 
to some of the noncompliant conclusions. This latter requirement was not publicly 
evident until the final IDEA 2004 regulations were provided in Sept of 2006, and thus it 
was not possible to account for this benchmark prior to that date. Also the requirement 
that Post School Goals be updated annually and be based upon age appropriate 
transition assessment also undermined the reporting of positive results. AUs were 
informed that they would be held harmless by not implementing all the requirements of 
IDEA 2004 until the final regulations were available, thus AUs did not move forward with 
this, and CDE did not provide statewide training on the assessment issue until fall of 
2006. This requirement most certainly contributed to such a low baseline rate. 

Some positive aspects of the data obtained include that finding that Colorado's state I EP 
form enables review for the Indicator 13 elements in an efficient way. Many small AUs 
had very good data and will be able to meet the full indicator with minor adjustments to 
practice and IEP authoring. Most of the AU Special Education Directors were very 
receptive to the overall results and looked forward to making changes to do better in the 
future. Most of all, this process has ignited new energy to the conversations related to 
transition and will undoubtedly contribute to meaningful change in the future. 

It is important to note that although Colorado used a tool that is rigorous and may have 
seemed overly stern to many in the field, the CDE remains confident that NSTTAC 
checklist is appropriate for assessing performance with regard to Indicator 13. All of the 
questions posed within the checklist cumulatively and appropriately answer the 
underlying Indicator question and are all essential elements to both meeting the minimal 
requirements of the reauthorization and in effectively planning transitions for youth. 

It is also important to note that although this checklist did measure for two elements we 
had not provided professional development and training for and because they were only 
released in the Federal IDEA Regulations released in September 2006, a significant 
portion of the files neglected transition planning all together. The CDE has developed a 
list of six main issues that were discovered from the collection of baseline data on this 
indicator that it will use in planning technical assistance and communications with AUs in 
both the short- and long-tem. 



FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 








2006 

(2006-2007) 


100% 


2007 

(2007-2008) 


100% 


2008 

(2008-2009) 


100% 
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FFY 


Measurable and Rigorous Target 


2009 

(2009-2010) 


100% 


2010 

(2010-2011) 


100% 



I improvement Activities/ Timelines/ Resources 

In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 










o= 


Ongoing; 








C= Complete; 








R= 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


1. Utilize 1 ndicator 13 


FFY 2007 


Contracted team members 


O 








review team to provide 


FFY 2008 


provide training to any AU who 










direct instruction and 


requests it. 










technical assistance. 


FFY 2009 














FFY 2010 












2. Provide TOPs Lite 


FFY 2007 


Training is provided when 


0 








transition training. 


FFY 2008 


requested. TOPs Lite covers 
more than just Indicator 13 












FFY 2009 


checklist requirements. 










3. Host Transition 


FFY 2006 


Two summer institutes have 


0 








Leadership Institute with 


FFY 2007 


been offered with almost all 










support of National 


AUs participating. Plans are 










Secondary Transition 


FFY 2008 


proceeding for 3 rd institute 










Technical Assistance 
Center (NSTTAC). 




summer 2009. 
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Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


4. Revise state 

recommended 1 EP forms 
to ensure all IDEIA 2004 
transition requirements 
are clearly prompted. 


FFY 2006 
FFY 2007 


1 EP forms revised. 

Training for all AUs occurred 
summer 2008. 




c 






5. Provide technical 

assistance and training 
via online tools, regional 
and local opportunities. 


FFY 2007 
FFY 2008 
FFY 2009 
FFY 2010 


Modules are in development. 

Regional trainings occur 
through regional cadre 
meetings. 

Cadre meetings are videotaped 
and made available to teams 
who cannot attend. 


O 








6. Continue to work 

collaboratively with the 
institutions of higher 
education of Colorado to 
ensure pre-service 
instruction is 
commensurate with 
IDEIA 2004 regulations 
and requirements. 


FFY 2006 
FFY 2007 
FFY 2008 


Faculty in higher education 
have been made aware of what 
training could look like and 
curriculum materials have been 
shared. 


O 








7. Collaborate with 
Colorado Community 
College System (CCCS) 
and Career and 
Technical Education 
(CTE) of Colorado to 
maximize postsecondary 
education opportunities 
for youth with 
disabilities. 


FFY 2008 
FFY 2009 
FFY 2010 


Secondary Services Team 
member will coordinate with 
the Governor appointed 
workgroup reviewing and 
recommending State Content 
Standards and accompanying 
assessments. 


0 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 










o= 


Ongoing; 








C= Complete; 








R= 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


8. Consider adopting 


FFY 2008 


The CDE has contracted with 


O 








workplace readiness 


FFY 2009 


the SWRCC at WestEd to review 










standards as part of the 


and analyze the Colorado Model 










Colorado State Content 


FFY 2010 


Content Standards including 










Standards required for 




review of major definitions 










all Colorado Students. 




related to College Readiness, 
and Career/ Postsecondary 
Readiness; Secondary Services 
team member will coordinate 
with the workgroup. 










9. 1 nclude transition skills 


FFY 2008 


Secondary Services team 


0 








in a working curriculum 


FFY 2009 


member will be assigned to Rtl 










for all students and 


workgroup. 










infusing transition 
activities and education 
into the intervention 


FFY 2010 


Team will review Rtl materials 
and training opportunities. 










toolbox associated with 


Rtl for all secondary 
students. 














10. Provide material review 


FFY 2006 


Consultation was available to 




c 






and 1 EP form 


FFY 2007 


any AU requesting help 










consultation as AUs are 


designing IEP forms that were 










revising 1 EP forms. 




not using the state 
recommended form. 










11. Provide training through 


FFY 2006 


Staff from each eligible facility 


0 








the Eligible Facilities 
JADe trainers to ensure 


FFY 2007 


have been trained. 










all eligible facilities staff 
are able to appropriately 
address 1 ndicator 13. 


FFY 2008 
FFY 2009 












12. Collaborate with NSTTAC 


FFY 2007 


Attended conferences in: 


0 








to further the CDE's 


FFY 2008 


Oklahoma, North Carolina, Utah 










understanding and 


(with MPRRC). 










practice. 




Attended planning institutes. 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


13. Utilize of AU staff to 
review 1 EPs as part of 
1 ndicator 13 record 
review. 


FFY 2008 
FFY 2009 
FFY 2010 


Staff are trained by review 
team prior to review. This 
allows for teams to build their 
capacity. 


O 








14. Partner with DVR to 
enhance School to Work 
Alliance Program 
(SWAP). 


FFY 2008 
FFY 2009 
FFY 2010 


State and local partners 
identified ways SWAP teams 
can collaborate with schools to 
improve transition assessment 
planning, and work-based 
opportunities. 


O 









Resources Used to Support Activities 

• CDE staff 

• Contracted vendors 

• Local AUs/SOPs 

• Cutting EdJ 

• NSTTAC 
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Revisions for FFY 2008 

The CDE is revising and/or adding improvement activities to better reflect current practices. 
Improvement activities are being added to continue through FFY 2010. 



Revised I mprovement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. Development of 1 ndicator 
13 Compliance Tips based 
on comments written for 
each of the 1,695 lEPs 
reviewed fall, 2008. 


First three Tips addressed 
first three questions of 1-13 
checklist. 

Emailed and mailed to 32 
Alls that participated in 1-13 
Fall, 2008 data collection, 
11/24/08, to assist in 
individual IEP correction. 

Will create similar resource 
for remaining three 1-13 
questions and electronically 
distribute statewide. 


FFY 2008 


Secondary 
Services team 


2. 1 ncrease support for 
transition planning from 
High School 
Administrators. 


Revise materials applicable to 
Administrators. 

Present at Administrator 
Conferences and workgroups. 

Place informational articles in 
the CDE newsletter that goes 
to all school Administrators. 


FFY 2008 


Secondary 
Services team 

Contract 1-13 
review team 

AU transition 
leaders 


3. Developl-13 Manual 
designed for use by both 
Alls and 1-13 File Review 
Team Members to 
demonstrate consistency 
and transparency and 
detail the review process, 
compliance tips, and 
available resources. 


Create a draft. 

Solicit feedback from 
stakeholders: CDE staff, 1-13 
file review team members, 

AU transition team leaders 
and members. 

Revise based on feedback. 

Share final copy electronically 
statewide. 


FFY 2008 


Secondary 
Services team 

Contract 1-13 
review team 

AU transition 
leaders 
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Sampling Plan: 



Special Education Student Sampling Table for Indicators 13 
Indicator 13: Secondary Transition with I EP Goals: Percent of youth age 16+ with 
IEP with measurable post school goals, measurable annual IEP goals that clearly align with 
the post school goals, and transition services to help the student move toward the post 
school goals. 

Indicator 13 data is collected through student file reviews in the fall based on the previous 
year's December count. For ease of understanding, this chart has been revised using school 
year rather than federal fiscal year. Discard any previous versions you may have of 
this chart. 

In the table below, the highlighted cells indicate the school year an administrative unit 
(All) or state operated program (SOP) is to be sampled for Indicator 13. AUs with total 
student enrollment of 50,000+ will be sampled annually. If, after the initial sampling the 
AU/SOP is found to be out of compliance, it will be subject to verification reviews until found 
to be in substantial compliance with the requirements of Indicator 13. 







Pilot 

Sample 

Year 


Year 1 


Year 2 


Year 3 


Year 4 


Year 5 




Indicator 13 

Collection Year 

(file review) 


2006-07 

from Dec 
'05 count 


2007-08 

from Dec 
'06 count 


2008-09 

from Dec 
'07 count 


2009-10 

from Dec 
'08 count 


2010-11 

from Dec 
'09 count 


2011-12 

from Dec 
'10 count 


01010 


Adams 1, Mapleton 








X 






01020 


Adams 12, Northglenn 












X 


01030 


Adams 14, 
Commerce City 




X 










01040 


Adams 27 J , Brighton 










X 




01070 


Adams 50, Westminster 


X 




X 








03010 


Arapahoe 1, Englewood 






X 








03020 


Arapahoe 2, Sheridan 




X 










03030 


Arapahoe 5, Cherry Creek 




X 


X 


X 


X 


X 


03040 


Arapahoe 6, Littleton 




X 










03060 


Adams-Arapahoe 28J, 
Aurora 






X 








07010 


Boulder RE-1J, St. Vrain 






X 








07020 


Boulder RE-2, 
Boulder Valley 










X 




15010 


Delta 50J 






X 








16010 


Denver 1 




X 


X 


X 


X 


X 
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Pilot 

Sample 

Year 


Year 1 


Year 2 


Year 3 


Year 4 


Year 5 




Indicator 13 

Collection Year 

(file review) 


2006-07 

from Dec 
'05 count 


2007-08 

from Dec 
'06 count 


2008-09 

from Dec 
'07 count 


2009-10 

from Dec 
'08 count 


2010-11 

from Dec 
'09 count 


2011-12 

from Dec 
'10 count 


18010 


Douglas RE-1 




X 


X 


X 


X 


X 


21020 


El Paso 2, Harrison 






X 








21030 


El Paso 3, Widefield 


X 






X 






21040 


El Paso 8, Fountain 


X 






X 






21050 


El Paso 11, 
Colorado Springs 








X 






21060 


El Paso 12, 
Cheyenne Mountain 












X 


21080 


El Paso 20, Academy 








X 






21085 


El Paso 38, Lewis Palmer 










X 




21090 


El Paso 49, Falcon 




X 










21490 


Fort Lupton/Keenesburg 












X 


22010 


Fremont RE-1, Canon City 




X 










26011 


Gunnison RE-1J 










X 




30011 


Jefferson R-l 




X 


X 


X 


X 


X 


35010 


Larimer R-l, Fort Collins 


X 




X 








35020 


Larimer R-2J, Loveland 












X 


35030 


Larimer R-3, Estes Park 






X 








38010 


Logan RE-1, Sterling 


X 






X 






39031 


Mesa 51, Grand J unction 




X 










41010 


Moffat RE-1, Craig 


X 






X 






43010 


Montrose RE-1J 




X 










44020 


Morgan RE-3, Fort Morgan 










X 




51010 


Pueblo 60, Urban 




X 










51020 


Pueblo 70, Rural 




X 










62040 


Weld RE-4, Windsor 




X 










62060 


Weld 6, Greeley 










X 




64203 


Centennial BOCES 












X 


64043 


East Central BOCES 


X 




X 








64053 


Mount Evans BOCES 








X 







Part B State Performance Plan: 2005-2010 
(OMB NO: 1820-0624 / Expiration Date: 2/29/2012) 



Page 125 of 176 



SPP Template - Part B (3) 



Colorado 







Pilot 

Sample 

Year 


Year 1 


Year 2 


Year 3 


Year 4 


Year 5 




Indicator 13 

Collection Year 

(file review) 


2006-07 

from Dec 
'05 count 


2007-08 

from Dec 
'06 count 


2008-09 

from Dec 
'07 count 


2009-10 

from Dec 
'08 count 


2010-11 

from Dec 
'09 count 


2011-12 

from Dec 
'10 count 


64093 


Mountain BOCES 










X 




64103 


Northeast BOCES 












X 


64123 


Northwest BOCES 










X 




64133 


Pikes Peak BOCES 












X 


64213 


Rio Blanco BOCES 












X 


64143 


San J uan BOCES 










X 




64153 


San Luis Valley BOCES 




X 










64160 


Santa Fe Trail BOCES 


X 






X 






64163 


South Central BOCES 






X 








64193 


Southeastern BOCES 










X 




64083 


Southwest BOCS 








X 






64200 


Uncompahgre BOCS 


X 




X 








64205 


Ute Pass BOCES 












X 


80010 


Charter School Institute 










X 




66050 


CSDB 




X 










66080 


Division of Youth 
Corrections 








X 
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Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: Effective General Supervision Part B / Effective Transition 



Indicator 14: Percent of youth who had lEPs, are no longer in secondary school and who 
have been competitively employed, enrolled in some type of postsecondary school, or both, 
within one year of leaving high school. 

(20 U.S.C. 1416(a)(3)(B)) 



Measurement: 

44.2% = 145 of youth who had lEPs, are no longer in secondary school and who have been 
competitively employed, enrolled in some type of postsecondary school, or both, within one 
year of leaving high school divided by 328 of youth assessed who had lEPs and are no 
longer in secondary school times 100. 



Overview of I ssue/ Description of System or Process 

At the end of the 2005-2006 school year, school districts were required to fill out a post- 
school outcomes exit survey for each student with an I EP who exited that year. All youth 
with lEPs who exited high school were included in the sample, including those who 
graduated, dropped out, aged out, graduated with a modified diploma or certificate of 
completion, and those who moved and were not known to be continuing. The survey 
asked for the student’s exit reason, transition goals and services provided, and student 
and family contact information. The contact information collected on this survey was 
used to contact students in the summer of 2007 to follow up on their progress a year 
after exiting high school. 

Sampling Process 

School districts across the state provided ESLU-CDE with exit survey data on a total of 
1,836 students with lEPs who had exited high school in 2005-2006. Contact information 
was provided to a third-party evaluation vendor, OMNI Institute, in two MS Excel files 
from which to draw samples of students to participate in the one-year post-school exit 
survey. Prior to drawing the samples, OMNI cleaned data files and removed 160 
students for whom no phone number or exit information was provided. A total of 1,676 
students remained in the two files, from which the samples were drawn. The first file 
contained 1,343 students representing 43 districts across the state, while 333 students 
were compiled in a separate file containing three large, urban districts. Three sequential 
samples were drawn from the pool of 1,343 students, yielding a final sample population 
of 895 students. Because the large, urban districts were likely to contain a higher 
proportion of minority and transient students, all 333 students were included in the 
calling sample in order to ensure that these students were adequately represented in 
collected data. Collectively, 1,228 student families were contacted to invite participation 
in the follow-up survey. This sample represented 73% of all exited students with contact 
information provided by local school districts. 
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Data Collection 

OMNI research staff conducted the phone interviews from June through September 
2007. 

The sample of 1,228 students was contacted up to 3 times each. When interviewers 
reached a household member, they invited exited student participation in the phone 
survey. Two bilingual staff members were available to administer the phone survey in 
Spanish with Spanish-speaking households. Although interviewers attempted to speak to 
the student whenever possible, it was often a parent who completed the survey. If 
respondents reported that the student had returned to a high school program at the 
time of the interview, this information was documented and the interview was 
discontinued. 

Survey Sample Description 

As shown in the table below, phone surveys were completed with 339 participants or 
37% of the total sampled. Of these participants, 11 indicated that the student had 
returned to school. Post-school outcomes were collected on a total of 328 students, who 
were no longer enrolled in secondary schools. 





Number 


% of Total 
Contacted 


% of 

Successful 

Contacts* 


Completed Surveys 


328 


27% 


72% 


Student had returned to 
school 


11 


.9% 


2.4% 


Refused Surveys 


116 


9% 


25% 


Total Successful Contacts 


455 


37% 


100% 


Wrong Numbers 


375 


30% 


N/ A 


No answer 


398 


33% 


N/ A 


Total Students Contacted 


1228 


100% 


N/ A 



♦Successful contacts = caller reached student or parent on the phone. 

OMNI staff was unable to successfully reach one-third of the sample. Almost another 
third of the sample contained invalid contact information. Among those successfully 
reached, 25% of respondents refused to participate in the survey, (this number 
represented nine percent of the total sample). In addition, 70% of those successfully 
reached were parents, and only four phone surveys were administered in Spanish. 

Additional work to assess the extent to which the AUs/districts that provided contact 
information represent the State as well as response rates within Alls will be conducted 
by J une 1, 2008. 
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Baseline Data for FFY 2004 (2004-2005) 

44.2% 

Discussion of Baseline Data 



Competitive Employment Definition and Results 

"Competitive employment" was defined as work in a competitive setting for pay without 
support, employment in the military, or work in a family member's home or business. 
Although the survey did not allow analysts to determine whether work in a family home 
or business was competitive, there were only four respondents who indicated this 
response. For the current effort, these participants were included with others defined as 
competitively employed. Based on this definition, survey results indicated that 57.6% 
(189) students with survey data were currently employed in a competitive setting. 

Full- and part-time status of those currently employed in a competitive setting was 
examined. Colorado’s definition of full- and part-time work does not match the federal 
definition of 35 or more hours worked per week. Many Colorado employers define "full- 
time work" differently, as indicated by survey response categories. For the purposes of 
the 2007 survey, any respondent who worked over 30 hours per week was defined as a 
full-time worker. According to this definition, survey results indicated that 69% (131) of 
students with survey data worked over 30 hours/week, while 26% (49) worked under 30 
hours/week. (Nine respondents did not know or refused to answer). 

Survey results indicated that an additional 58 respondents had been employed in the 
past year but were not currently employed. It is unknown whether this employment met 
the standard definition of competitive employment. 

Education Definition and Results 

"Postsecondary education" was defined as enrollment in any educational or vocational 
training program, including employment training programs, vocational school, 2- and 4- 
year colleges, military training, and enrollment in studies while incarcerated. GED and 
life skills programs were not included in this definition. 

Full- and part-time enrollment status was included in the survey, but this analysis was 
limited as full-time and part-time status was not specifically indicated by a total number 
of hours. Therefore the definition of full- and part-time enrollment may vary by 
respondent. 

Survey results indicate that 44% (145) of respondents were currently enrolled or had 
been enrolled in some form of postsecondary education. 68% of these respondents (99) 
were enrolled full-time, while 29% (42) were enrolled part-time. (Four respondents 
refused to answer whether they attended full- or part-time). 

Survey results also indicate that 26% (86) of respondents were both competitively 
employed and enrolled in a postsecondary education program. 

Limitations 

There were several limitations of the 2007 survey instrument that limited analyses: 

■ The survey did not accurately capture the federal definition of full-time work (35+ 
hours/week), nor did it specify full-time student enrollment hours. 
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■ The survey did not specifically ask whether the respondent was paid minimum wage, 
therefore it could not be determined whether respondents who worked in a family 
members' home or business were competitively employed. 

■ Furthermore, the survey did not measure whether past employment was in a 
competitive setting. 

■ Finally, neither the school exit survey used to select the sample nor the outcomes 
survey collected information on gender, ethnicity, and disability; therefore Colorado 
cannot describe the students in these terms or accurately conclude that the results are a 
representative sample of the state. 

The survey will be adjusted to address these limitations during the 2008 data collection. 

In addition, ESLU-CDE will work with local school districts to improve exit data, with 
particular focus on the collection of valid contact information. This work will improve the 
number of successful contacts and completed surveys, as 30% of the respondents 
contacted had disconnected or wrong numbers. 



FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 


48% 


2006 

(2006-2007) 


52% 


2007 

(2007-2008) 


56% 


2008 

(2008-2009) 


60% 


2009 

(2009-2010) 


64% 


2010 

(2010-2011) 


68% 
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I mprovement Activities/ Timelines/ Resources 

In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 










o= 


Ongoing 


f 








C= Complete; 








R = 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


1. Design an exiter survey 


FFY 2006 


The survey is reviewed annually 


O 








and data collection plan. 


FFY 2007 


and revised based on data. 












FFY 2008 














FFY 2009 














FFY 2010 












2. 1 dentify all students with 


FFY 2006 


Information included in EOY 




c 






lEPs who have dropped 
out, graduated with a 
diploma or certificate of 
completion, or aged out. 


FFY 2007 


data collection for 2007. 










3. Gather post-school data 


FFY 2006 


Use OMNI for research or 


O 








on students identified as 


FFY 2007 


similar strategy to contact 










exiters during 2006- 


students each year. 










2007. 


FFY 2008 














FFY 2009 














FFY 2010 












4. Build baseline of exit and 


FFY 2006 


Baseline data reported in SPP. 




c 






post-school outcome 
data annually. 














5. Analyze data at state 


Fall FFY 


Data collection requirements 


0 








and AU level, continue to 


2007 and 


and survey questions included 










improve surveys and 


each fall 


in Indicator 13 training to 










reports based upon data 


thereafter 


support development of 










analysis; include 




Measurable Post-school Goals 










integration into 
indicators 1, 2, and 13 of 
SPP. 




and Annual Goals. 
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Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


6. Set annual and six year 
rigorous and measurable 
targets based upon 
baseline data. 


Reviewed 
in FFY 
2008 


Targets established in SPP. 




c 







Resources Used to Support activities 

• ESLU Secondary Services Team 

• AU Special Education Directors 

• AU Data Managers 

• OMNI Institute 

• National Post-school Outcomes Center 

• Secondary Services Contract staff 

Revisions for FFY 2007 

The CDE is revising and/or adding improvement activities to better reflect current practices. 
Improvement activities are being added to continue through FFY 2010. 

Some improvement activities are being revised or deleted to better reflect current practices. 
Improvement activities are being added to reflect current practices, address state level 
initiatives in post school and workforce readiness and to address data concerns. 

The low response rate is a continuing concern. Lack of contact information, or outdated 
information was a major barrier to the CDE's inability to obtain complete surveys. In an 
attempt to improve the completed survey rate to provide a more representative sample, 
ESLU will work with the National Post-school Outcomes Center and AU representatives to 
research and identify strategies to collect accurate contact data and conduct surveys. 

The CDE has fully embraced the philosophy and implementation of the Rtl model statewide. 
The Secondary Services Team will coordinate with the CDE's internal Rtl workgroup to 
develop materials and training options to assist secondary schools in Rtl implementation 
including transition planning and services as an effective intervention. 

In response to new legislation, the Governor has charged the Commissioner of the CDE and 
the State Board of Education with the task of reviewing and revising the State Content 
Standards. Efforts are underway to consider and include workplace readiness skills as well 
as academic skills with the intention of preparing youth for postsecondary education and the 
world of work. A member of the Secondary Services Team will work closely with the task 
force to influence the integration of workplace standards and align efforts across the CDE. 
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Revised I mprovement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. 1 nclude information about 


Develop End of Year data 


FFY 2006 


Secondary 


students exiting school or 
special education in the 
Special Education End of 
Year data collection. 


definitions. 

Get approval from internal 
data review board. 


FFY 2007 
FFY 2008 
FFY 2009 


Services staff 

Data and 
research staff 




Train AUs on new data 


1 nformation 




elements. 


FFY 2010 


Management 

Services 


2. Provide AU Special 


Develop report format. 


FFY 2008 


General 


Education Directors 






Supervision 


Indicator 14 data specific 






team 


to their AU when sample 
size is too small to be 






Secondary 


publicly reported (N < 






Services team 


30). 






OMNI 
1 nstitute 


3. The CDE will work with 


In collaboration with the 


March 2009 


CDE Staff 


AUs to improve exit data, 


National Post-school 




AU Transition 
Teams 


with particular focus on 


Outcomes Center, research 




the collection of valid 


techniques used by other 




contact data. 


states. 




National Post- 




Convene a work group of AU 
representatives to identify 
and recommend strategies. 


March 2009 


school 

Outcomes 

Center 




Include technical assistance 
and training in Summer 
Transition Leadership 
Institute and Regional Cadre 
meetings. 


J une 2009 




4. Research options for data 


Contact other States to 


March 2009 


CDE Staff 


collection process. 


identify strategies used for 




National Post- 




effective data collection . 




MIULIVI 1 U 1 1 W J L 

school 

Outcomes 

Center 








State 

Department 

Contacts 
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Activity 


Action Steps 


Timeline 


Resources 


5. Include transition skills in 
a working curriculum for 
all students and infusing 
transition activities and 
education into the 
intervention toolbox 
associated with Rtl for all 
secondary students . 


Secondary Services team 
member will be assigned to 
Rtl workgroup. 

Team will review Rtl 
materials and training 
opportunities. 


March 2009 
and 

ongoing 


ESLU Staff 

CDE Staff 
from other 
Units 

Local 

Directors 


6. Collaborate with Colorado 
Community College 
System (CCCS) and 
Career and Technical 
Education (CTE) of 
Colorado to maximize 
postsecondary education 
opportunities for youth 
with disabilities. 


Secondary Services Team 
member will coordinate with 
the Governor appointed 
workgroup reviewing and 
recommending State Content 
Standards and accompanying 
assessments. 


Dec. 2008 
and 

ongoing 


ESLU Staff 

CDE Staff 
from other 
Units 


7. The CDE will consider 
adopting workplace 
readiness standards as 
part of the Colorado State 
Content Standards 
required for all Colorado 
Students. 


The CDE has contracted with 
the SWRCC at WestEd to 
review and analyze the 
Colorado Model Content 
Standards including review of 
major definitions related to 
College Readiness, and 
Career/ Postsecondary 
Readiness; Secondary 
Services team member will 
coordinate with the 
workgroup. 


March 2008 
and 

ongoing 


ESLU Staff 

CDE Staff 
from other 
units 



Sampling Plan 

The CDE intends to continue the use of sampling of AUs over the remaining period of 
Colorado's FFY2005-2010 State Performance Plan. In fall 2006, the CDE developed a 5 
year sampling plan for the remaining five years of Colorado’s SPP. All AUs that 
participated in the baseline data collection described above were re-entered into the 5 
year sampling plan. Therefore, all of Colorado’s 57 Administrative Units will participate 
in the Parent Survey data collection between FFY2006 and FFY2010. 

The sampling calculator developed by the National Post School Outcomes Center was 
used for the purpose of developing the 5 year sampling plan. AU characteristics that 
were factored into the process were as follows: 

• Number of AUs 

• AU region (urban/suburban vs. rural) 

• AU size 

• Percent of AU population disabled 
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• Percent of SPED population in 4 disability categories (LD, ED, MR and all other 
disabilities) 

• Gender of SPED population 

• Percent of SPED population that is non-white (total minority) 

• Percent of SPED population that is Hispanic 

• Percent of SPED population that is 15 years of age or older 

The CDE drew approximately 35 separate plans using the sampling calculator and 
considered 20 of them. Serious consideration was given to the 6 best solutions. While 
all the solutions had difficulty containing year-to-year variation in the total minority and 
Hispanic variables within +/ 3 percentage points of the state percentage, the chosen plan 
maintained no more than +/- 3 percentage points variation from the state for all the 
disability categories and provided the best solution in terms of the variation in 
race/ ethnicity over the 5 years of the plan. This was especially true for the percent 
Hispanic variable, which is a key demographic variable in Colorado. 

The comparison of each year's sample to the overall state percentages is shown in the 
table on the next page. The highlighted cells represent differences from the state 
percentage in excess of +/- 2 percentage points. The specific Alls that will be sampled 
in each year of the 5 year plan are shown in a subsequent table. 

The CDE intends to invite all parents of students with lEPs in the Alls from each year's 
sample to participate in the survey. As discussed earlier, the CDE is actively working on 
improving its response rates on the parent survey with the goal of exceeding 60% within 
2 years. If return rates do not dramatically improve within the next two years, the CDE 
may move away from trying to survey all parents in the Alls sampled each year to 
drawing a parent sample from each AU in the plan and using the off-set in resources to 
conduct extensive follow-up procedures with these parents. 

Finally, additional student demographic characteristics will also be collected to help 
assess the extent to which each year's respondents represent the state as a whole. 
Dependent on the outcome of this year-to-year assessment, the CDE may employ 
weighting techniques to help ensure comparability of the results over the 5 year period 
of the sampling plan. 

July 2007 Update: Sampling plan was updated because the Post-School Outcomes 

sampling calculator did not properly bring in the AUs with an average daily member ship 
of over 50,000 students. The yearly sample characteristics in the below tables does not 
reflect the four largest AUs that will sampled every year of the sampling plan. About 
20% of the parents from these large AUs will be randomly selected for participation in 
the survey per year. Additionally, the Colorado School for the Deaf and Blind will be 
included in the FFY2006 sample and Department of Youth Corrections will be included in 
the FFY2008 sample. This sampling plan is now identical to the plan for Indicators 13 
and 14 (Part C to B transitions and Post School Outcomes, respectively) based on 
feedback from the Colorado's Educational Data Advisory Committee (EDAC). 
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Sample 




State 


FFY2006 


FFY2007 


FFY2008 


FFY2009 


FFY2010 


Size 


521393 


104724 


104886 


93094 


111399 


107560 


SPED 


57353 


11590 


11189 


10105 


11398 


10540 


% LD 


37 


38 


37 


36 


39 


36 


% ED 


10 


9 


9 


9 


10 


11 


% MR 


4 


5 


4 


5 


3 


4 


% AO 


49 


47 


50 


52 


48 


49 


% Female 


32 


33 


32 


32 


32 


32 


% Minority 


38 


35 


32 


45 


34 


34 


% Hispanic 


26 


27 


23 


27 


29 


25 


% 15 Years + 


23 


24 


23 


23 


23 


23 



In the table below, the highlighted cells indicate the school year an administrative unit 
(All) or state operated program (SOP) is to submit demographic information in EOY 
reporting. ** Please note that this sampling plan has not changed for I ndicators 14 and 8. 
Aus with total student enrollment of 50,000+ will be sampled annually. 





1 ndicator 8 and 14 

Collection Year 

(demographic 
1 nformation) 


2006-07 

from EOY 
2005-06 


2007-08 

from EOY 
2006-07 


2008-09 

from EOY 
2007-08 


2009-10 

from EOY 
2008-09 


2010-11 

from EOY 
2009-10 


2011-12 

from EOY 
2010-11 


01010 


Adams 1, Mapleton 








X 






01020 


Adams 12, Northglenn 






X 








01030 


Adams 14, Commerce 
City 




X 










01040 


Adams 27 J , Brighton 










X 




01070 


Adams 50, Westminster 












X 


03010 


Arapahoe 1, Englewood 






X 








03020 


Arapahoe 2, Sheridan 




X 










03030 


Arapahoe 5, Cherry 
Creek 




X 


X 


X 


X 


X 


03040 


Arapahoe 6, Littleton 




X 










03060 


Adams- Arapahoe 28J, 
Aurora 








X 
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1 ndicator 8 and 14 

Collection Year 

(demographic 
1 nformation) 


2006-07 

from EOY 
2005-06 


2007-08 

from EOY 
2006-07 


2008-09 

from EOY 
2007-08 


2009-10 

from EOY 
2008-09 


2010-11 

from EOY 
2009-10 


2011-12 

from EOY 
2010-11 


07010 


Boulder RE-1J, St. Vrain 












X 


07020 


Boulder RE-2, 
Boulder Valley 










X 




15010 


Delta 50J 








X 






16010 


Denver 1 


X 


X 


X 


X 


X 


X 


18010 


Douglas RE-1 


X 


X 


X 


X 


X 


X 


21020 


El Paso 2, Harrison 












X 


21030 


El Paso 3, Widefield 








X 






21040 


El Paso 8, Fountain 








X 






21050 


El Paso 11, 
Colorado Springs 






X 








21060 


El Paso 12, 
Cheyenne Mountain 






X 








21080 


El Paso 20, Academy 








X 






21085 


El Paso 38, 
Lewis Palmer 










X 




21090 


El Paso 49, Falcon 




X 










21490 


Fort Lupton/Keenesburg 






X 








22010 


Fremont RE-1, 
Canon City 




X 










26011 


Gunnison RE-1J 










X 




30011 


J efferson R-l 




X 


X 


X 


X 


X 


35020 


Larimer R-2J, Loveland 












X 


35030 


Larimer R-3, Estes Park 












X 


38010 


Logan RE-1, Sterling 






X 








39031 


Mesa 51, 

Grand J unction 




X 










41010 


Moffat RE-1, Craig 








X 






43010 


Montrose RE-1J 




X 










44020 


Morgan RE-3, 
Fort Morgan 










X 




51010 


Pueblo 60, Urban 




X 










51020 


Pueblo 70, Rural 




X 










62040 


Weld RE-4, Windsor 




X 
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1 ndicator 8 and 14 

Collection Year 

(demographic 
1 nformation) 


2006-07 

from EOY 
2005-06 


2007-08 

from EOY 
2006-07 


2008-09 

from EOY 
2007-08 


2009-10 

from EOY 
2008-09 


2010-11 

from EOY 
2009-10 


2011-12 

from EOY 
2010-11 


62060 


Weld 6, Greeley 










X 




64203 


Centennial BOCES 












X 


64043 


East Central BOCES 






X 








64053 


Mount Evans BOCES 








X 






64093 


Mountain BOCES 










X 




64103 


Northeast BOCES 












X 


64123 


Northwest BOCES 










X 




64133 


Pikes Peak BOCES 






X 








64213 


Rio Blanco BOCES 












X 


64143 


San J uan BOCES 










X 




64153 


San Luis Valley BOCES 




X 










64160 


Santa Fe Trail BOCES 








X 






64163 


South Central BOCES 






X 








64193 


Southeastern BOCES 










X 




64083 


Southwest BOCS 








X 






64200 


Uncompahgre BOCS 












X 


64205 


Ute Pass BOCES 






X 








80010 


Charter School Institute 










X 




66050 


CSDB 




X 










66080 


Division of Youth 
Corrections 








X 







Part B State Performance Plan: 2005-2010 
(OMB NO: 1820-0624 / Expiration Date: 2/29/2012) 



Page 138 of 176 



SPP Template - Part B (3) 



Colorado 



Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: Effective General Supervision Part B / General Supervision 



Indicator 15: General supervision system (including monitoring, complaints, hearings, 
etc.) identifies and corrects noncompliance as soon as possible but in no case later than one 
year from identification. 

(20 U.S.C. 1416 (a)(3)(B)) 



Measurement: 

A. Percent of noncompliance related to monitoring priority areas and indicators corrected 
within one year of identification: 

a. # of findings of noncompliance made related to monitoring priority areas and 
indicators. 

b. # of corrections completed as soon as possible but in no case later than one year from 
identification. 

Percent = b divided by a times 100. 

For any noncompliance not corrected within one year of identification, describe what 
actions, including technical assistance and/or enforcement that the State has taken. 

B. Percent of noncompliance related to areas not included in the above monitoring priority 
areas and indicators corrected within one year of identification: 

a. # of findings of noncompliance made related to such areas. 

b. # of corrections completed as soon as possible but in no case later than one year from 
identification. 

Percent = b divided by a times 100. 

For any noncompliance not corrected within one year of identification, describe what 
actions, including technical assistance and/or enforcement that the State has taken. 

C. Percent of noncompliance identified through other mechanisms (complaints, due process 
hearings, mediations, etc.) corrected within one year of identification: 

a. # of agencies in which noncompliance was identified through other mechanisms. 

b. # of findings of noncompliance made. 

c. # of corrections completed as soon as possible but in no case later than one year from 
identification. 

Percent = c divided by b times 100. 

For any noncompliance not corrected within one year of identification, describe what 
actions, including technical assistance and/or enforcement that the State has taken. 
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Overview of I ssue/ Description of System or Process 

The Continuous Improvement and Monitoring Process (CIMP) is carried out in 3 phases 
with Phases I and II typically lasting 1 school year. The current monitoring schedule 
was determined in 2000 and took into consideration the most recent monitoring 
activities of Administrative Units. All Administrative Units in Colorado will have gone 
through Phases I and II of CIMP by the end of the 2007-08 school year. Administrative 
Units have either 4000 students or 400 students identified with disabilities, or operate 
under a variance, or are a Board of Cooperative Educational Services (BOCES) where 
many districts have pooled their resources to provide special education services. 

Phase I is a data gathering and self-assessment phase. During Phase I the special 
education director identifies a steering committee to guide the process. The steering 
committee is a representative sample of all the stakeholders from the administrative 
unit. Their job is to review the current status of special and gifted education services by 
collecting and analyzing data, identifying accomplishments and effective practice, and 
determining areas of need within the Administrative Unit. Data drives the Phase I 
process and includes: 

• Staff Survey (conducted by CDE) 

• Parent Survey (conducted by CDE) 

• Dec. 1 count data (compiled by CDE) 

• Suspension/Expulsion data 

• Achievement data (compiled by CDE and the Administrative Unit) 

• Student Record Review (conducted by CDE and Administrative Unit) 

Phase I also requires the special education director and/or steering committee to 
complete a self-assessment that examines all aspects of special education services 
provided by the Administrative Unit. This self-assessment mirrors the Administrative 
Unit Checklist that is written at the completion of the verification visit that occurs in 
Phase 1 1 . 

Phase II is the verification phase. The CDE verifies the issues identified by the steering 
committee which include identifying areas of commendation, areas that are acceptable 
and areas of non-compliance. Verification is done through interviews, focus groups, file 
reviews and observations. At the conclusion of this visit, the CDE team issues a report. 
It is important to note that this report is also copied to the superintendent/ executive 
director and the relevant CDE Regional Managers. Any areas of no-compliance are cited. 
The Administrative Unit then has 90 days to provide the CDE with an Improvement Plan 
that targets all the areas of non-compliance. These areas are to be corrected within 1 
year of the date the report is issued. 

After the Improvement Plan has been developed and accepted by the CDE, the unit 
enters Phase III. In Phase III the Administrative Unit provides the CDE with evidence of 
change that ensures that all compliance issues are being addressed and will be corrected 
within 1 year. Phase 1 1 1 is the "continuous" part of the process. While an Administrative 
Unit may remain in Phase III for years, it is intended that the Units develop 
improvement plans that address recommendations that were made during Phase II. The 
CDE conducts Targeted Visits once a year to review and discuss the evidence 
documenting all compliance issues until every issue is addressed and corrected. 
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Targeted visits may occur more often than once a year, depending on the need as 
determined by the CDE. 

In addition to monitoring corrective action and improvement plans, the CDE conducts a 
desk audit every year to review performance on selected targets that include the 
December 1 count and student outcome measures. Based on these factors, 
Administrative Units may continue in Phase III, have sanctions applied or re-enter Phase 

I. 

There are four acknowledgements and four sanctions that the CDE can use in 
conjunction with the CIMP process. In addition, CIMP can be tied to district accreditation 
and compliance concerns can hinder a district from being accredited. The Exceptional 
Student Services Unit and the Regional Managers are working hard at making sure 
concerns related to exceptional students are brought into the discussion. The 
acknowledgements are: 

1. Through the identification of exceptional commendations during CIMP, a letter of 
accomplishment could be signed by the Commissioner of Education and sent to 
the school board, superintendent/ executive director and director of special 
education of the administrative unit, highlighting the specific commendable 
services. 

2. Promising educational practices and evidence of promising outcomes identified 
during the CIMP or other reviews of administrative units and schools could be 
posted on the state website, especially those relating to increased achievement 
for students with disabilities. 

3. Strengths identified during the CIMP and listed in the executive summary of the 
final CIMP report will continue to be issued to the school district/BOCES. 

4. Strengths noted during the CIMP will be highlighted during the Accreditation 
Review Process. 

The sanctions that CDE can impose are: 

1. The executive summary/issues of any noncompliance and needed improvement 
will be included in the district accreditation report, listed in the final CIMP report 
and made available to the public through the CDE website. Any administrative 
unit not demonstrating progress towards a corrective action after one year's 
period of time could be at-risk of losing its accreditation through the accreditation 
review process. 

2. The results of the CIMP include an improvement plan that administrative units 
will implement, identifying professional development and technical assistance 
strategies that helps to move the Administrative Unit in that direction. Within 
reasonable timelines, if noncompliance items are not remedied as agreed upon in 
an improvement plan, a letter of concern will be sent to the school board, 
superintendent and director of special education, and copied to the CDE regional 
manager. While CDE would only take this step if necessary, the potential to 
delay funding as a result of inaction is one option to ensure correction. 

3. During a target visit, if determined that compliance is still not corrected, the 
administrative unit may be referred for follow up through CIMP to re-enter into 
the data collection and verification process. The Administrative Unit would be 
responsible for funding a team to oversee the continued data analysis and 
implementation of an improvement plan. Additionally, the Administrative Unit 
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would not be eligible for sliver grants awarded from the Exceptional Student 
Services Unit of the CDE. 

4. If noncompliance continues to exist, and it is deemed that no action has been 
taken to implement the strategies, the Administrative Unit could be placed on 
probation for those items remaining in corrective action and CDE would delay or 
withhold funding as described in the Rules Section 7.05(6). 

February 2007 Update (Refinement & Clarification of the of Continuous Improvement 
Monitoring Process (CIMP) -- In lieu of what was presented above in Colorado's 
FFY2005-2010 SPP (highlighted in gray) : 

The CDE's General Supervision system includes monitoring, 618 data collection 
procedures, Federal Application process, dispute resolution and technical assistance. 
Each process is described below: 

Monitoring 

The Continuous Improvement and Monitoring Process (CIMP) is carried out in 3 phases 
with Phases I and II typically lasting 1 school year. The current monitoring schedule 
was determined in 2000 and took into consideration the most recent monitoring 
activities of Administrative Units. All Administrative Units in Colorado will have gone 
through Phases I and II of CIMP by the end of the 2007-08 school year. Administrative 
Units have either 4000 students or 400 students identified with disabilities, or operate 
under a variance, or are a Board of Cooperative Educational Services (BOCES) where 
many districts have pooled their resources to provide special education services. 

Phase I is a data gathering and self-assessment phase. During Phase I the special 
education director identifies a steering committee to guide the process. The steering 
committee is a representative sample of all the stakeholders from the administrative 
unit. Their job is to review the current status of special and gifted education services by 
collecting and analyzing data, identifying accomplishments and effective practice, and 
determining areas of need within the Administrative Unit. Data drives the Phase I 
process and includes: 

• Staff Survey (conducted by CDE) 

• Parent Survey (conducted by CDE) 

• Dec. 1 count data (compiled by CDE) 

• Suspension/Expulsion data 

• Achievement data (compiled by CDE and the Administrative Unit) 

• Student Record Review (conducted by CDE and Administrative Unit) 

Phase I also requires the special education director and/or steering committee to 
complete a self-assessment that examines all aspects of special education services 
provided by the Administrative Unit. This self-assessment mirrors the Administrative 
Unit Checklist that is written at the completion of the verification visit that occurs in 
Phase 1 1 . 

Phase II is the verification phase. The CDE verifies the issues identified by the steering 
committee which include identifying areas of commendation, areas that are acceptable 
and areas of non-compliance. Verification is done through interviews, focus groups, file 
reviews and observations. At the conclusion of this visit, the CDE team issues a report. 
It is important to note that this report is also copied to the superintendent/ executive 
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director and the relevant CDE Regional Managers. Any areas of no-compliance are cited. 
The Administrative Unit then has 90 days to provide the CDE with an Improvement Plan 
that targets all the areas of non-compliance. These areas are to be corrected within 1 
year of the date the report is issued. 

After the Improvement Plan has been developed and accepted by the CDE, the unit 
enters Phase III. In Phase III the Administrative Unit provides the CDE with evidence of 
change that ensures that all compliance issues are being addressed and will be corrected 
within 1 year. Phase 1 1 1 is the "continuous" part of the process. While an Administrative 
Unit may remain in Phase III for years, it is intended that the Units develop 
improvement plans that address recommendations that were made during Phase II. The 
CDE conducts Targeted Visits once a year to review and discuss the evidence 
documenting all compliance issues until every issue is addressed and corrected. 
Targeted visits may occur more often than once a year, depending on the need as 
determined by the CDE. 

In addition to monitoring corrective action and improvement plans, the CDE conducts a 
desk audit every year to review performance on selected targets that include the 
December 1 count and student outcome measures. Based on these factors, 
Administrative Units may continue in Phase III, have sanctions applied or re-enter Phase 

I. 

616 Data Collection 

For the 2005-06 school year, Colorado’s 618 data was collected in two ways. The 
annual student count and exit data, collected in December 1 was collected using custom 
software that ran on a DOS platform. LEAs were asked to provide exit data for students 
that were no longer enrolled in the LEA, update records for students that were still 
enrolled and add student records as appropriate. All data, after being verified at the LEA 
level, was uploaded to a CDE mainframe and data verification was done to assure an 
unduplicated count of students throughout the state. If duplication was suspected, the 
LEAs involved in the possibly duplication were contacted to gather additional information 
and a determination was made as to which LEA was eligible to count the student in 
question. The discipline data was collected at the end of the year using a Microsoft 
Excel application with an ACCESS database to store the data. The LEA submitted the 
data and then the data was reviewed and summarized by the CDE prior to submission to 
Westat. 

Dispute Resolution 

CDE has in effect procedures for resolving disputes consistent with 34 C.F.R. §§ 300.151 
through 300.153 (state complaint procedures), 300.506 (mediation) and 300.507 
through 300.515 (due process complaint procedures). The responsible dispute 
resolution consultant maintains a database for maintaining relevant and necessary 
information regarding mediation, state complaints (called "federal complaints” in 
Colorado), and due process complaints, including names of the parties, pertinent dates, 
issue identification, resolution data, and corrective action data, if applicable. 

A description of the CDE's dispute resolution process follows: 

Mediation : Mediation is made available at no cost to parties who have disputes 

involving any matter under Part B. Mediation is a voluntary process on the part of the 
parties and is not used deny or delay any of the parent’s rights under Part B. If a 
mediation agreement is reached, it is reduced to writing in the form of a binding 
mediation agreement which is enforceable in any court of competent jurisdiction. 
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CDE has on contract four (4) trained mediators who are available for assignment to Part 
B mediations. The mediators are independent contractors who possess strong mediation 
skills and are trained in special education law. CDE provides annual training for the 
mediators and requires their mandatory attendance at Exceptional Student Services' 
Annual Special Education Legal Conference. 

CDE actively and strongly encourages parties to consider resolving their disputes 
through mediation. Such encouragement is typically provided under the following 
circumstances: (1) when a parent contacts CDE to find out what his/her dispute 

resolution rights are, (2) when a state complaint (called a "federal complaint" in 
Colorado) is filed; or when a due process complaint is filed. When encouraging parties 
to consider mediation, the dispute resolution consultant makes clear that mediation may 
not be used to deny or delay any of the rights available under Part B; however, the 
parties may jointly request that a due process hearing or a federal complaint be held in 
abeyance for a reasonable period of time until the mediation is completed. When CDE 
receives a request for mediation, the responsible dispute resolution consultant confirms 
that both parties are voluntarily agreeing to mediation and then assigns a mediator to 
the case. 

CDE is revising its mediation procedures to require that, if the parties requesting 
mediation wish that a federal complaint investigation or a due process complaint/hearing 
be stayed during the course of the mediation, the parties must jointly make the request 
in writing with an anticipated end date for the mediation. If the federal complaints 
officer (FCO) or impartial hearing officer (I HO) grants the requested stay, the order 
granting the stay must establish through an order: (1) a date certain for when the 

mediation must be competed, and (2) a new decision due date. If the parties resolve 
their disputes through a written and binding written mediation agreement or some other 
method, the parties notify the FCO (in the case of a federal complaint) or the I HO (in the 
case of a due process complaint) that the agreement has been reached and that that the 
complaint is being withdrawn or should be dismissed. If no agreement or only partial 
agreement is reached, the complaint investigation or due process hearing procedures 
resume. CDE's FCO and other dispute resolution consultants, IHOs and mediators will 
be trained on revised procedures at the annual Impartial Hearing Officer & Mediators 
training scheduled for 02/07/07. 

CDE does not identify compliance issues involved in disputes that are mediated and 
ultimately resolved due to the confidential nature of the mediation process. It is 
presumed that such issues are unique to each individual case and are not systemic in 
nature. 

Federal Complaints Process 

The federal complaints process is available to any party. When a federal complaint 
("complaint") is filed, the FCO has up to ten (10) calendar days to review the complaint 
to determine whether (1) CDE has jurisdiction to investigate the complaint (i.e., whether 
the complaint as alleged states a violation of the IDEA), (2) the complaint meets 
required content requirements, and (3) was filed within the applicable statute of 
limitations. The statute of limitations for the federal complaints reported in this State 
Performance Plan was one (1) year unless a claim for compensatory services was made 
and/or the IDEA violations were alleged to be continuing in nature, in which case the 
FCO ordered a reasonable look back period of as many as three years. If the complaint 
is rejected, the complainant must be notified within ten (10) calendar days following the 
decision to reject the complaint. 
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When a complaint is accepted for investigation, the regional liaison for the 
administrative unit (AU) and the CIMP coordinator are notified of the complaint, which is 
made available to both the regional liaison and CIMP coordinator. 

The complaint must be resolved within sixty (60) calendar days of the date of its filing, 
unless the FCO extends the decision due date for exceptional circumstances unique that 
complaint. The pertinent AU is given the opportunity to respond in writing to the 
complaint, and the parent is given the opportunity to reply to the AU's written response. 

Following the exchange of written information, the FCO may further investigate as 
necessary using a variety of investigative techniques including telephone interviews and 
on-site investigations. Upon completion of the investigation, the FCO issues a decision 
that must contain findings of fact and conclusions of law. 

If the FCO finds the AU to be in violation of the IDEA, the FCO orders a remedy, which 
may include corrective action which may include compensatory services, the revision of 
policies and procedures, staff training, etc. The remedy establishes dates for when the 
remedy must be completed and documentation submitted demonstrating that corrective 
action has been taken. A copy of the decision is made available to the CDE/ESSU 
regional liaison for the AU and the CIMP coordinator. The decision is placed in the AU's 
monitoring file and serves as a data source for monitoring. 

Follow-up for corrective action is currently the responsibility of the FCO. However, CDE 
is considering whether a change in follow-up responsibility for violations deemed to be 
systemic should be made from the FCO to the appropriate regional liaison. 

CDE's FCO is a licensed attorney and one of ESSU's dispute resolution consultants. The 
FCO participates in the bi-monthly complaint investigator telephone conference calls 
provided by the Mountain Plains Regional Resource Center (MPRRC). The FCO also 
attends special education legal conferences such as LRP's National Institute on Legal 
Issues of Education Individuals with Disabilities. 

Due Process Flearinqs 

Per current state rules, the special education director for the AU is required to notify 
CDE immediately upon receipt of a due process hearing request and to fax a copy of the 
due process complaint to CDE. Per current state rules, the responsible dispute 
resolution consultant makes available to the AU and the parent a list of three (3) 
available I HOs from the I HO registry maintained by CDE. The parent strikes one name, 
the AU strikes one name and dispute resolution consultant assigns the remaining I HO to 
the case. In the case of an expedited hearing, the first available I HO on a rotating list is 
assigned to the case. For purposes of this State Performance Plan, due process hearings 
were required to be completed within 45 calendar days unless an extension of that 
timeline was requested by one of the parties. Colorado is a two-tier system and any 
party to a due process hearing may appeal to an administrative law judge who renders a 
decision on behalf of the Commissioner of Education/CDE. 

When CDE is notified of a due process hearing request from the AU special education 
director, the responsible dispute resolution consultant notifies the CDE/ESSU regional 
liaison for the AU and the CIMP coordinator of the due process complaint and makes the 
due process complaint available to them. If the I HO finds the AU to be in violation, the 
hearing decision has also been made available to the AU regional liaison and CIMP 
coordinator. The hearing decision is placed in the AU's monitoring file and serves as a 
data source for monitoring. 
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In the past, CDE has not required the AU found to be in violation to take corrective 
action as it has long been assumed that due process hearings involve individual issues, 
not systemic issues. Based on recent conversations with CADRE, CDE will be revising its 
procedures to (1) develop criteria for determining whether a due process decision 
involves systemic violations, and (2) develop more uniformity state-wide regarding the 
forms and practice used by IHOs in granting extensions to the 45-day timeline when 
requested by one of the parties. These issues will be discussed at a day-long hearing 
officer and mediator training scheduled for 02/07/07. 

CDE maintains a registry of IHOs who are available to conduct impartial due process 
hearings. The IHOs are required to be licensed attorneys. The IHOs are required to 
attend an annual special education law training day hosted by CDE as well as ESSU's 
Annual Legal Conference. In addition, the IHOs are encouraged to participate in the bi- 
monthly Hearing Officer Teleconference calls hosted by MPRRC. 

Enforcement Activities 

Our enforcement activities have changed since the submission of the 2004-05 State 
Performance Plan. In May 2006 our constituents approved the following enforcement 
actions and acknowledgements. Also, in addition to the actions listed below, any citation 
of significant disproportionality due to placement, identification or disciplinary actions 
will also trigger the use of early intervening funds to require the AU to use 15% of their 
allocations towards this focus. 

ACTIONS 

All administrative unit Continuous Improvement and Monitoring Process (CIMP) 
executive summaries will be made available to the public through the CDE website. The 
executive summary includes areas of strength, noncompliance and needed corrective 
actions, and general recommendations. For all administrative units with noncompliance 
citations, issues of any noncompliance and needed improvement will be included in the 
district accreditation report. Areas of strength should also be included in the 
accreditation report where appropriate. 

ACKNOWLEDGEMENTS 

Through the identification of exceptional performance during CIMP, a letter of 
accomplishment could be signed by the commissioner and sent to the school board, 
superintendent/executive director and director of special education of the administrative 
unit, highlighting the specific areas of strength. 

SANCTIONS 



SANCTION 1. Letter of Concern 

The results of the CIMP include an improvement plan that administrative units will 
develop and implement, identifying professional development and technical assistance 
strategies that assist the administrative unit in meeting the goals of its plan. If 
noncompliance items are not remedied within one year from the date of issuance of the 
CIMP Executive Summary and Report), a letter of concern will be sent to the school 
board, superintendent, and director of special education, and copied to the CDE regional 
manager. 
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SANCTION 2. Ineligible for Sliver Grants 

If noncompliance persists beyond one year, the administrative unit will not be eligible for 
sliver grants awarded from the CDE ESSU. 

SANCTION 3. Re-enter Data Collection or Verification at AU Expense 

If non-compliance persists beyond one year, the administrative unit will be referred for 
follow up through CIMP to re-enter the data collection or verification process. The 
Administrative Unit would be responsible for funding a team to oversee the continued 
data analysis and implementation of an improvement plan. 

SANCTION 4. Accreditation Watch 

If noncompliance persists beyond one year, the administrative unit will be placed on 
accreditation watch through the CDE accreditation review process. 

SANCTION 5. Withhold Funding and Accreditation Probation 

If noncompliance persists beyond one year, CDE will delay or withhold funding as 
described in the ECEA Rules Section 7.05(6) and the administrative unit will be placed 
on accreditation probation. 

The enforcement activities are closely tied to other units within the Colorado Department 
of Education. All general supervision findings that result in non-compliance are shared 
with the Regional Manager responsible for that Administrative Unit. This helps us 
coordinate our technical assistance efforts. 

Baseline Data for FFY 2003 (2003-2004) 

Data is from the 11 Administrative Units that were monitored during the 2003-04 
school year. 



15A. Federal Monitoring Priorities 
Area of General Supervision: 

4 citations made 

FAPE in the LRE (including Transition): 

15 citations made 

Suspension/ Expulsion: 

4 citations made 

Child Find: 

3 citations 

Total: 

26 citations 



1 corrected 



10 corrected 



0 corrected 



0 corrected 



11 corrected 



42.3% corrected within 1 year of citation 



15B. Other areas the CDE monitored for: 

Resource allocation: 

15 citations 5 corrected 
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Professional Development: 

3 citations 0 corrected 

Hearing/Vision Screening: 

2 citations 1 corrected 

Eligibility/I EP Process 

10 citations 4 corrected 

Confidentiality 

1 citation 1 corrected 

Total 

31 citations 11 corrected 

35.5% corrected within 1 year of citation 

15C. 2004 Due Process 

1 citation 1 corrected 

100.0% corrected within 1 year of citation 

2003 and 2004 Federal Complaints 

21 citations 21 corrected 

100.0% corrected within 1 year of citation 



Discussion of Baseline Data 

The CDE recognizes that it needs to improve upon follow-up procedures after an 
Administrative Unit is cited for non-compliance. The CDE is committed to adjusting is 
Monitoring Process so that non-compliance is corrected within the one-year timeline. 
Historically, follow-up procedures have been limited due to lack of dedicated staff, but 
CDE is currently addressing the issue to bolster the overall Monitoring system. While 
follow-up is clearly an area for improvement, the strength of the current CIMP system is 
that it thoroughly addresses issues of non-compliance using multiple indicators and 
multiple methods of data collection. 

The system in Colorado for Complaints and Due Process is such that when a decision is 
made which favors the family, corrective action is required from the school district. 
These action plans are reviewed are followed-up on frequently by CDE's team of 
consultants who work specifically with Due Process and Federal Complaints, leading to 
100% correction within 1 year of citation. 
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FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 


100% 


2006 

(2006-2007) 


100% 


2007 

(2007-2008) 


100% 


2008 

(2008-2009) 


100% 


2009 

(2009-2010) 


100% 


2010 

(2010-2011) 


100% 



For each AU for which compliance is cited, the CDE: 

• Completes a targeted visit at the AU within one year from the date the report 
was issued to (a) confirm all targets are met with no outstanding compliance 
issues; (b) confirm that the AU is on target with improvement and (c) 
consider sanctions (as indicated in the State Performance Plan). 

• Provide written documentation of the targeted visit to the AU. 

• Continues to make targeted visits until all areas of compliance are 
successfully addressed. (At a minimum 1 targeted visit per year should be 
documented in writing for the central files). 

• When applicable, issues a letter to the AU stating that all compliance issues 
have been corrected. 

For all AUs in Colorado, the CDE: 

• Reviews the AU's Annual Performance Profile, CSAP data, any Federal 
Complaint decisions and any Due Process decisions annually. With regard to 
this review, CDE investigates all areas that are outside of the typical range. 

Local Comprehensive Plans 

Every AU has on file a local comprehensive plan with the CDE. CDE has reviewed all local 
comprehensive plans to ensure consistency with IDEA 1997 and Colorado's Exceptional 
Children's Education Act (ECEA) and its implementing rules. Further, each AU has been 
required to submit a letter of assurance that it will comply with IDEA 2004 until the ECEA 
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Rules are aligned with IDEA 2004 and its regulations, at which time the local comprehensive 
plans must be revised consistent with the amended ECEA Rules. 

Compliance Determinations 

Since July 2006, CDE has developed standards for determining what constitutes 
"compliance" following a citation of noncompliance to an AU. Fundamental to these 
standards is acknowledging the reality that it takes time for data to accurately reflect 
whether corrective action results in a change of practice. The standards utilized by CDE to 
make compliance determinations are: 

• Has the AU developed, adopted and implemented policies and procedures that 
are intended to and are also likely to remedy the noncompliance? 

• Has the AU taken immediate, demonstrable steps to implement such policies 
and procedures? 

• Is the AU effectively beginning to address the noncompliance? 

• Do the policies and procedures have future sustainability to continue ensuring 
compliance should staff or administration change? 

If all of these standards are met, then CDE clears the outstanding noncompliance. 

Starting July 15, 2005 the Exceptional Student Services Unit of the Colorado Department of 
Education made a commitment to carry out the following plan: 

• Complete a targeted visit at the administrative unit within one year from the 
date the report was issued to (a) confirm all targets are met with no 
outstanding compliance issues; (b) confirm Administrative Unit is on target 
with improvement and (c) consider sanctions (see above). 

• Provide written documentation of the targeted visit to the Administrative Unit. 

• Continue to make targeted visits until all areas of compliance are successfully 
addressed. (At a minimum 1 targeted visit per year should be documented in 
writing for the central files). 

• Issue a letter to the Administrative Unit stating that all compliance issues 
have been corrected when applicable. 

• Review Annual Performance Profile, CSAP data, Federal Complaints and Due 
Process annually. Investigate all areas that are outside of typical range. 

In addition, every Administrative Unit has submitted a comprehensive plan to our office to 
come into compliance with IDEA 1997. All Administrative Units are required to also submit 
a letter of assurance that they will comply with IDEA 2004 until we have national 
regulations and state rules and regulations. At that time the comprehensive plans will be 
revised to make changes to come into compliance. 

For the 2006-07 school year, Colorado’s 618 data will be collected using Colorado’s 
Automated Data Exchange (ADE) process which allows the LEA to create a file, in a specified 
format, and submit that file through a secure website. Edits and warnings are provided to 
the LEA based on established business rules to assist the LEA in the verification of their 
data. After all edits are passed the LEA will approve their data and submit a form signed by 
the Special Education Director certifying the accuracy of the data. Once all LEAs have 
approved their data verification will be done to assure an unduplicated count of students 
throughout the state. If duplication is suspected the LEAs involved will be notified and the 
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LEA that submitted the record in error will be asked to resubmit their data file without the 
duplicated record. Colorado's exit data for the 2006-07 school year will be submitted 
through a new End-of-Year student system that is being developed. This discipline data will 
be collected at the end of the year using a new version of the Microsoft Excel application 
that was used for the 2005-06 school year which will incorporate the new reporting 
requirements. 

Additionally, the Exceptional Student Services Unit at the Colorado Department of Education 
will be re-designing our monitoring, and more globally, our entire General Supervision 
system to more closely align with the SPP/ APR requirements. A task force representing our 
staff, local special education directors and parents will meet to determine what is in place, 
what is needed, and how we can develop a system that ensures compliance within a timely 
manner while still focusing on outcomes of students. 

I improvement Activities/ Timelines/ Resources 

In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 




Status * 










* Status 
Notations: 










o= 


Ongoing 


f 








C= Complete; 








R = 


Revised; 










D = 


Deleted 










O 


C 


R 


D 


1. Revise the Cl MP process 


FFY 2007 


Monitoring materials were 


O 








to more closely align 


FFY 2008 


revised and approved by the 










with the Indicators and 


Education Data Advisory 










Related Requirements as 


FFY 2009 


Committee (EDAC). In addition 










well as the 


FFY 2010 


to initial implementation, the 










determinations process. 


process is being evaluated and 
refined. 












2. Create work teams to 


FFY 2007 


Work teams established; 










address each of the 


FFY 2008 


evaluation procedures 


O 








indicators. Teams 


developed and implemented; 








analyze data, evaluate 


FFY 2009 


technical assistance and 










AU policies, procedures, 


FFY 2010 


professional development 










and practices impacting 


projects/activities aligned with 










each indicator, and 




SPP indicators are developed 










identify technical 
assistance to support 
AUs to enhance practices 
to improve performance. 




and implemented. 
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Activity 


Timeline 


Results or Progress 


Status * 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


3. Develop strategies to 
evaluate performance 
related to each indicator. 


FFY 2007 
FFY 2008 
FFY 2009 
FFY 2010 


Evaluation strategies reviewed, 
revised and implemented. 


O 








4. 1 ncrease training of CDE 
Consultants to improve: 

(1) service to AUs and 

(2) attention to 
identification of 
noncompliance and 
verification of corrective 
actions using valid and 
reliable strategies to 
collect and analyze 
quantitative and 
qualitative data. 


FFY 2007 
FFY 2008 
FFY 2009 
FFY 2010 


Consultants participate in 
monthly topical training during 
staff meetings and regional 
liaison meetings. 


O 








5. Revise local 

Comprehensive Plans 
that reflect the changes 
in the ECEA Rules. 


FFY 2007 
FFY 2008 
FFY 2009 
FFY 2010 


CDE staff are reviewing and 
revising templates and models. 


0 








6. General supervision 
system includes 
notification to the 
AU/District of the 
requirement for 
correction within one 
year of notification of the 
noncompliance; 
establishment of 
strategies to verify 
correction of 
noncompliance; and 
adherence to timelines 
for verification activities. 


FFY 2007 
FFY 2008 
FFY 2009 
FFY 2010 


CDE staff and AU Directors 
have been trained regarding 
requirements. 


0 









Part B State Performance Plan: 2005-2010 
(OMB NO: 1820-0624 / Expiration Date: 2/29/2012) 



Page 152 of 176 






SPP Template - Part B (3) 



Colorado 



Activity 


Timeline 


Results or Progress 




Status * 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


7. Revise Continuous 
1 mprovement and 
Monitoring Process 
Acknowledgements and 
Sanctions as General 
Supervision Process 
Acknowledgements and 
Enforcement Actions. 


FFY 2008 


Following public participation, 
the revised Enforcement 
Actions were adopted. 




c 







Resources Used to Support Activities 

• CDE Personnel from ESLU 

• Data and Research Unit 

• Prevention Initiatives Unit 

• Contractors/vendors 

• ESLU receives individual AU data and presents indicator specific information at 
statewide Directors' meetings. 
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SPP Template - Part B (3) 



Colorado 



Revisions for FFY 2008 

Improvement activities are being added to reflect current practice and to continue through 
FFY 2010. 

Revised I mprovement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. Re-align ESLU resources to 
provide local regional 
contacts to verify 
implementation of 
corrective action plans and 
correction of findings of 
noncompliance are timely 
corrected. 


Identify local regional contacts 
to serve as Special Education 
Regional Consultants. 

Provide training for Special 
Education Regional Consultants. 

Special Education Regional 
Consultants develop working 
relationships with AU Special 
Education Directors. 

Special Education Regional 
Consultants verify timely 
implementation of corrective 
action plans and assist with 
timely correction of 
noncompliance. 


FFY 2009 
FFY 2010 


Special 

Education 

Regional 

Consultants 

General 

Supervision 

Team 


2. Revise monitoring 
materials to align with 
current requirements and 
focused monitoring 
system. 


Revise Administrative Unit 
checklist that provides platform 
for monitoring. 

Revise manual describing the 
Continuous Improvement and 
Monitoring Prociess. 

Implement focused monitoring 
system as Cl MP. 


FFY 2009 
FFY 2010 


General 

Supervision 

Team 
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SPP Template - Part B (3) 



Colorado 



Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: Effective General Supervision Part B / General Supervision 



For FFY 2008 the language for Indicator 16 was changed. The Indicator now reads: 

Indicator 16: Percent of signed written complaints with reports issued that were resolved 
within 60-day timeline or a timeline extended for exceptional circumstances with respect to 
a particular complaint, or because the parent (or individual or organization) and the public 
agency agree to extend the time to engage in mediation or other alternative means of 
dispute resolution, if available in the State. 

(20 U.S.C. 1416(a)(3)(B)) 



Measurement: Percent = [(1.1(b) + 1.1(c)) divided by 1.1] times 100. 

Data Source: Data collected on Table 7 of Information Collection 1820-0677 (Report of 
Dispute Resolution Under Part B of the Individuals with Disabilities Education Act). 



Overview of I ssue/ Description of System or Process 

The Exceptional Student Services Unit (ESSU), Colorado Department of Education (CDE) 
employs two Federal Complaints Officers. Complaints are assigned on a rotating basis 
between the two complaints officers. Once a complaint is received within this office, the 
complaints officer has 10 days within which to either accept or reject the complaint. If a 
complaints officer finds exceptional circumstances, an extension beyond the 60 day 
timeline may be granted, for a reasonable period of time. Examples of circumstances 
that are exceptional include a complaint involving an extraordinarily large volume of 
documentation or a key witness/party is unavailable. 

Baseline Data for FFY 2004 (2004-2005) 

100% of complaints were completed within 60 days or the extended timeline in FFY2004 

Discussion of Baseline Data 

Colorado does not receive a large number of complaints and meeting the required 
timelines is typically not an issue. Each officer takes about half of the complaints 
received on a rotating basis. 



FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 


100% 


2006 

(2006-2007) 


100% 
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SPP Template - Part B (3) 



Colorado 



FFY 


Measurable and Rigorous Target 


2007 

(2007-2008) 


100% 


2008 

(2008-2009) 


100% 


2009 

(2009-2010) 


100% 


2010 

(2010-2011) 


100% 



I improvement Activities/ Timelines/ Resources 

In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


1. Track corrective action 


FFY 2005 


The CDE continues to track 


0 








plans as required in the 


ffy 9nn^ 


information and refine the 










Complaints Officer's 


r r T zuuo 


internal policy to sustain 










findings. 


FFY 2007 


consistency with 












FFY 2008 


submission/ response timelines. 












FFY 2009 














FFY 2010 
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SPP Template - Part B (3) 



Colorado 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


2. Research a software 
system that will allow for 
coordination of 
calendaring, tracking 
and data/document 
management of dispute 
resolution cases in order 
to improve systems 
administration. 


FFY 2008 
FFY 2009 


This improvement activity is 
ongoing. CDE staff have 
reviewed four software 
systems. Flowever, the 
systems reviewed were either 
inappropriate given CDE's 
needs or unaffordable. CDE 
continues to explore efficient 
and affordable systems. 


O 









Resources Used to Support Activities 

• Data Management of Dispute Resolution Access Database 

• Outlook Calendaring 

• Dispute Resolution Team 
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SPP Template - Part B (3) 



Colorado 



Part B State Performance Plan (SPP) for 2005-2010 

Overview of the State Performance Plan Development 



Monitoring Priority: Effective General Supervision Part B / General Supervision 



The language for Indicator 17 has changed. The indicator now reads: 

Indicator 17: Percent of adjudicated due process hearing requests that were adjudicated 
within the 45-day timeline or a timeline that is properly extended by the hearing officer at 
the request of either party or in the case of an expedited hearing, within the required 
timelines. 

(20 U.S.C. 1416(a)(3)(B)) 



Measurement: Percent = [(3.2(a) + 3.2(b)) divided by 3.2] times 100. 

Data Source: Data collected on Table 7 of Information Collection 1820-0677 (Report of 
Dispute Resolution Under Part B of the Individuals with Disabilities Education Act). 



Overview of I ssue/ Description of System or Process 

The CDE operates under a 2-tiered due process system. The first level is conducted by 
the impartial hearing officer. Hearing officers are assigned on a two-strike system. 
Once a request is received in this office, three hearing officers are placed on a list, based 
on rotation and availability. From this list the parties each strike one name, and the 
remaining name from the list of three is the hearing officer assigned to the case. There 
are currently 13 hearing officers on our rotation list. All hearing officers are attorneys 
who are knowledgeable about IDEA and attend a yearly training conducted by ESSU. 

An appeal of a hearing officer decision is sent to the State Division of Administrative 
Hearings and assigned on a rotating basis from a pool of Administrative Law J udges. 

Baseline Data for FFY 2004 (2004-2005) 

100% within timelines for FFY2004 
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SPP Template - Part B (3) 



Colorado 



Discussion of Baseline Data 

The 45 day timeline within which to render a decision is now being more closely 
monitored by ESSU in order to comply with IDEA requirements and OSEP findings. 
Meeting the timelines is typically not a problem in Colorado. 



FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 


100% 


2006 

(2006-2007) 


100% 


2007 

(2007-2008) 


100% 


2008 

(2008-2009) 


100% 


2009 

(2009-2010) 


100% 


2010 

(2010-2011) 


100% 
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SPP Template - Part B (3) 



Colorado 



I mprovement Activities/ Timelines/ Resources 

In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


1. Implement a "tickler" 
system of notification; a 
software project is in 
development for future 
use . 


FFY 2008 


Staff continues to monitor 
timelines through the use of an 
access database. This activity 
will continue to sustain 
compliance until a software 
system is procured and 
implemented. See 
Improvement Activity # 3 
below. 




c 






2. The Department 
continues to provide 
training to due process 
hearing officers, 
including special 
education legal 
requirements, decision 
timelines and decision 
drafting. 


Quarterly 


Flearing officers remain up to 
date on legal requirements and 
timelines for decisions. Flearing 
officers have submitted timely 
decisions or proper extensions. 
Colorado has met the target of 
100% and will continue training 
to sustain 100% compliance. 


O 








3. The Department is 
researching a software 
system that will allow for 
coordination of 
calendaring, tracking 
and data/document 
management of dispute 
resolution cases in order 
to improve systems 
administration. 


FFY 2008 
FFY 2009 


This improvement activity is 
ongoing. As of this date CDE 
staff have reviewed four 
software systems. Flowever, 
the systems reviewed were 
either inappropriate given 
CDE's needs or unaffordable. 
CDE continues to explore 
efficient and affordable 
systems. 


O 
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SPP Template - Part B (3) 



Colorado 



Resources Used to Support Activities 

• Data Management of Dispute Resolution Access Database 

• Outlook Calendaring 

• Dispute Resolution Team 

Revisions for FFY 2007 

The CDE is revising and/or adding improvement activities to better reflect current practices. 
Improvement activities are being added to continue through FFY 2010. 

The CDE has implemented a Resolution Meeting form that both parties must sign. This form 
allows the CDE to track occurrence and outcome of resolution meetings. For Indicator 17, it 
allows for the tracking of any change to timelines (e.g., parties' waiver of the resolution 
meeting) in order to inform the Flearing Officers of any modification of decision dates. This 
form was implemented J anuary 1, 2008. 



Revised I improvement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. The Department is 
researching a software 
system that will allow for 
coordination of 
calendaring, tracking and 
data/document 
management of dispute 
resolution cases in order 
to improve systems 
administration. 


IT staff research. 

Trial use. 

Determination of 
effectiveness. 

Purchase and training. 


FFY 2008 
FFY 2009 


CDE IT staff 

CDE General 

Supervision 

team 
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SPP Template - Part B (3) 



Colorado 



Part B State Performance Plan (SPP) for 2005-2010 

Overview of the State Performance Plan Development 



Monitoring Priority: Effective General Supervision Part B / General Supervision 



I ndicator 18: Percent of hearing requests that went to resolution sessions that were 
resolved through resolution session settlement agreements. 

(20 U.S.C. 1416(a)(3(B)) 



Measurement: 

Percent = 3.1(a) divided by (3.1) times 100. 



Measurement: 

100% = 7 divided by 7 times 100. 



Overview of I ssue/ Description of System or Process 

ESSU has a tracking system to record timelines and resolution outcomes. 

Baseline Data for FFY 2005 (2005-2006) 

100% 

Discussion of Baseline Data 

Although Colorado reached 100% for resolution sessions that were resolved through 
resolution session settlement agreements in FFY 2005, the CDE feels that 80% is a 
realistic expectation for high performance on this Indicator across the life of the SPP. 



FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 




2006 

(2006-2007) 


80% 


2007 

(2007-2008) 


80% 
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SPP Template - Part B (3) 



Colorado 



FFY 


Measurable and Rigorous Target 


2008 

(2008-2009) 


80% 


2009 

(2009-2010) 


80% 


2010 

(2010-2011) 


80% 



I mprovement Activities/ Timelines/ Resources 

In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


1. Modify ESLU dispute 
resolution database to 
include 1 DEA 2004 
required information. 


Began 
Fall 2005 


ESLU staff continue to track all 
required timelines and related 
documentation. 




c 






2. Continue the provision of 
case management and 
data tracking. 


FFY 2007 
FFY 2008 
FFY 2009 


Integrating dispute resolution 
with monitoring systems for 
coordinated tracking. 


O 








3. 1 ncorporate this indicator 
into software 
development 
/integration of 
proprietary software to 
help staff more easily 
monitor and notify 
hearing officers. 


FFY 2007 
FFY 2008 
FFY 2009 


This improvement activity is 
ongoing. As of this date CDE 
staff has reviewed four 
software systems. However, 
the systems reviewed were 
either inappropriate given 
CDE's needs or unaffordable. 
CDE continues to search for an 
efficient and affordable system. 


O 
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SPP Template - Part B (3) 



Colorado 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


4. Develop and implement 
strategies for identifying 
the factors that result in 
failed resolution 
sessions, including 
follow-up with the 
parties. 


FFY 2007 
FFY 2008 
FFY 2009 


The CDE has researched 
nationwide resolution meeting 
data and is continuing to 
research factors that impact 
resolution meeting outcomes. 
Based on a random sample of 9 
states (2006 APR data), the 
CDE found that the average 
percentage for resolution 
meetings resulting in an 
agreement was 52% - a 
percentage that is comparable 
to a CADRE study of 22 states 
(2005) with an average of 
59%. Follow-up with the 
parties is an ongoing activity 
and indicates that either the 
30-day resolution period is too 
short for parties to resolve 
disagreements and/or 
agreements are being reached 
but not reduced to writing. 


O 








5. Development and 
implementation of a 
process for obtaining 
accurate data regarding 
resolution session 
outcomes, including 
number of resolution 
sessions resulting in 
resolution session 
agreements and 
identification of whether 
resolution session 
timelines have been 
met. 


FFY 2008 
FFY 2009 
FFY 2010 


A Resolution Meeting 
Verification Form has been 
developed and implemented as 
of 1/1/08. The form is 
completed by the parties. It 
reports the outcome of the 
resolution meeting and is 
submitted to the CDE. 


O 
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SPP Template - Part B (3) 



Colorado 



Resources Used to Support Activities 

• Data Management of Dispute Resolution Access Database 

• Outlook Calendaring 

• ESLU Dispute Resolution Team 
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SPP Template - Part B (3) 



Colorado 



Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: Effective General Supervision Part B / General Supervision 

Indicator 19: Percent of mediations held that resulted in mediation agreements. 

(20 U.S.C. 1416(a)(3)(B)) 

Measurement: 

Percent = ( 2. 1( a) ( i) + 2. 1( b) ( i) ) divided by (2.1) times 100. 



Overview of Issue/ Description of System or Process 

Colorado has a system that allows for mediation of special education related disputes 
between parents and education agencies. Mediators are available statewide and have 
been trained on both mediation strategies and IDEA requirements. ESSU utilizes the 
services of 4 contract Mediators. Mediations are assigned on a rotating basis and on 
availability of the Mediator. Mediators are, by virtue of their respective careers, trained 
in mediation techniques and knowledgeable about IDEA and attend a yearly training 
conducted by ESSU. 

Baseline Data for FFY 2004 (2004-2005) 

60% of mediation requests resulted in a mediation agreement 

Discussion of Baseline Data 

Because mediation sessions are confidential, it is unclear what factors lead to 60% of 
mediations resulting in a mediation agreement. Colorado does not feel that tracking the 
mediation process in greater detail is appropriate since the confidential nature of the 
sessions is what drives a greater level of candor and is a major reason why this avenue 
is often more appealing to the parties involved. 



FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 


63% 


2006 

(2006-2007) 


66% 


2007 

(2007-2008) 


69% 
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SPP Template - Part B (3) 



Colorado 



FFY 


Measurable and Rigorous Target 


2008 

(2008-2009) 


72% 


2009 

(2009-2010) 


75% 


2010 

(2010-2011) 


78% 



I improvement Activities/ Timelines/ Resources 

In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 












Notations: 

0 = Ongoing; 
C = Complete 
R= Revised; 
D = Deleted 


f 








O 


C 


R 


D 


1. Utilize an anonymous 


FFY 2006 


The Dispute Resolution 


O 








post- mediation 


FFY 2007 


Team assesses results at 










evaluation form for all 


least yearly to drive future 










parties involved. 


FFY 2008 


planning and systems 












FFY 2009 


modifications. 










2. Conduct annual trainings 


FFY 2005 


Two trainings conducted 


O 








for mediators on special 


FFY 2006 


(one annual and one 










education legal 


supplemental). 










requirements. 


FFY 2007 














FFY 2008 














FFY 2009 
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SPP Template - Part B (3) 



Colorado 



Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 
0=Ongoing; 
C=Complete; 
R= Revised; 
D= Deleted 


O 


c 


R 


D 


3. Identify funding sources 
to pay for mediator 
trainings and/or sending 
mediators to national 
conferences, such as the 
Annual Legal Conference 
and the LRP Special 
Education conferences. 


Deleted 


The CDE is providing 
training to the mediators. 
They access MPRRC 
Mediation teleconferences 
and are attending the 
Annual Special Education 
Legal Conferences. 








D 


4. Conduct a panel 

discussion at the 2008 
Special Education Legal 
Conference regarding the 
benefits of mediation and 
the process involved. 


Completed 


The CDE showed a 15% 
increase in requests for 
mediation from calendar 
year 2007 to 2008. 




c 






5. Contact mediators to 
determine factors 
resulting in lack of 
written agreements. 


FFY 2007 
FFY 2008 
FFY 2009 


Data collected from 
mediators and synthesized 
by staff. 


O 









Resources Used to Support Activities 

• Data Management of Dispute Resolution Access Database 

• Outlook Calendaring 

• Dispute Resolution Team 

Revisions for FFY 2008 

Improvement activities are being added to continue through FFY 2010. 
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SPP Template - Part B (3) 



Colorado 



Revised I mprovement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. Contact mediators to 
determine factors 
resulting in lack of written 
mediation agreements. 


Review Mediator close-out 
letters. 

Contact mediator by 
telephone or email. 

Synthesize data. 


FFY 2009 
FFY 2010 


CDE Dispute 
Resolution 
Team and 
Mediators 
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SPP Template - Part B (3) 



Colorado 



Part B State Performance Plan (SPP) for 2005-2010 



Monitoring Priority: Effective General Supervision Part B / General Supervision 



Indicator 20: State reported data (618 and State Performance Plan and Annual 
Performance Report) are timely and accurate. 

(20 U.S.C. 1416(a)(3)(B)) 



Measurement 

State reported data, including 618 data and annual performance reports, are: 

a. Submitted on or before due dates (February 1 for child count, including race and 
ethnicity, placement; November 1 for exiting, discipline, personnel; and February 1 for 
Annual Performance Reports); and 

b. Accurate (describe mechanisms for ensuring accuracy). 



Overview of I ssue/ Description of System or Process 

Colorado utilizes two mechanisms for Administrative Units to submit required data on 
special education students. First, a diskette system is utilized for reporting of December 
1 Child Count, LRE data, and December 1 Exit and Personnel Data. Second, an extract 
to diskette system is posted to CDE's Website that facilitates the collection of discipline 
data at the end of each school year. Both systems have the following resources in place 
to ensure accurate and timely submissions: 

• Hard-copy instruction packets and detailed data definitions 

• Web-based instructions and detailed data definitions available on the CDE's 
website 

• Availability of telephone technical assistance 

• Regular trainings for all Administrative Unit data managers 

• Data submission trainings for SPED directors. 

Data verification is done using numerous edits and reports built into the data collection 
system. For student data, once data is received from an Administrative Unit, the CDE 
does manual checks to ensure unduplicated counts. For staff data, qualifications of all 
staff are manually checked against a caseload and licensure database. While these 
verification checks have generally been adequate in the past, a task force being created 
to develop additional verification procedures for inclusion in the web-based submission 
system currently under development. 

To ensure timely submissions of the state's Annual Performance Reports, the CDE has 
hired dedicated staff to conduct ongoing assessments of data collection systems and to 
convene internal teams to manage, analyze and report on indicators on an ongoing basis 
to meet the timelines imposed by OSEP. 
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SPP Template - Part B (3) 



Colorado 



Baseline Data for FFY 2004 (2004-2005) 

On-time submissions for state reported data: 100% 



Discussion of Baseline Data 



In FFY, all state reported data will be collected using an on-line reporting data collection 
system instead of the current diskette system utilized for most of the collection. This 
will help ensure timeliness and help improve data verification systems. The CDE will fold 
edit check requirements provided by WESTAT into the development of this Web-based 
data submission system. 

Due dates for the next fiscal year are as follows: 



December 1 Student Data 
December 1 Staff Data 
End-of-Year Exit Data 
Discipline Data 



December 1, 2006 
December 1, 2006 
End-of-Year 2006/2007 
End-of-Year 2006/2007 



FFY 


Measurable and Rigorous Target 


2005 

(2005-2006) 


100% 


2006 

(2006-2007) 


100% 


2007 

(2007-2008) 


100% 


2008 

(2008-2009) 


100% 


2009 

(2009-2010) 


100% 


2010 

(2010-2011) 


100% 
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SPP Template - Part B (3) 



Colorado 



I mprovement Activities/ Timelines/ Resources 

In the original SPP dated December 2005 Improvement activities were suggested to 
continue throughout FFY 2010. Below is an update of the progress and results of those 
activities. 



Activity 


Timeline 


Results or Progress 


Status* 

* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 


O 


c 


R 


D 


1. Create task force to 

assess efficacy of current 
verification systems. 


FFY 2005 


Verification systems needed to 
be updated. 




c 






2. Continue to gather 
stakeholder input 
through public 
participation on 
development of web 
based data submission 
system. 


FFY 2005 


Two web based systems were 
developed. 




c 






3. Develop architecture to 
support web based 
system. 


FFY 2006 


Systems were developed and 
are updated annually. 




c 






4. Develop Technical 

Assistance material and 
media for web based 
system. 


FFY 2006 


Available on CDE's website at 
htto: // www. cde. state, co. us/cde 
spedfin/l ndex SEFD.htm. 




c 






5. Launch web based 
system. 


FFY 2006 


Two systems were launched. 




c 






6. Provide technical 

assistance and trainings 
on new system. 


FFY 2006 


Regional training and individual 
technical assistance provided. 




c 






7. Critical appraisal of new 
system and modify as 
needed. 


FFY 2006 
FFY 2007 
FFY 2008 
FFY 2009 
FFY 2010 


Systems continue to be 
modified by refining edits, data 
elements and definitions. 


O 
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SPP Template - Part B (3) 



Colorado 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


8. Realignment within ESLU 
to enhance CDE's level 
of influence. 


FFY 2006 
FFY 2007 


618 data collection team and 
the SPP/APR team is now one 
team under General 
Supervision. 




c 






9. Provide regional 
trainings on student data 
elements, definitions and 
how to submit count 

10. Revised, see p. 175, 
Improvement Activity # 
2. 


FFY 2008 


9 trainings were held 
throughout the state on the 
Special Education End of Year 
collection. Audience for 
training included Child Find 
Coordinators, Special Education 
Directors and Data Managers. 






R 




11. Reorganize the CDE to 
bring data collection 
under Data and 
Research Unit. 


FFY 2008 


The Data and Research Unit 
(now named Data Services Unit 
(DSU)) and the Exceptional 
Student Leadership Unit (ESLU) 
work collaboratively to 
implement three data 
collections (i.e., End of Year, 
December count/Child count, 
Discipline). The DSU, with the 
assistance of Information 
Management Services (IMS), 
handles the technical aspects of 
the collection (e.g., file 
submission, programming) 
while the ESLU handles the 
content and provides technical 
assistance to the AUs. 




c 






12. Develop reports 

embedded in collection 
to ensure accountability 
and accuracy of data. 


FFY 2008 
FFY 2009 


Reports specific to each 
indicator are in relevant 
collections. Reports continue to 
be refined for increased 
accuracy. Reports are added 
every year to assist the CDE 
and AUs in monitoring and in 
validating data. 


O 
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SPP Template - Part B (3) 



Colorado 



Activity 


Timeline 


Results or Progress 




Status* 










* Status 
Notations: 

0 = Ongoing; 
C= Complete; 
R= Revised; 

D = Deleted 








O 


C 


R 


D 


13. Develop data warehouse 
to access special 
education data. 


FFY 2008 
FFY 2009 


Programmer for special 
education was hired. 


O 








14. Coordinate EDEN 
submission. 


FFY 2008 


EDEN coordinator and 
programmers were hired. CDE 
is now 'EDEN only’ for several 
of the special education 
collections. 




c 
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SPP Template - Part B (3) 



Colorado 



Resources Used to Support Activities 

• ESLU General Supervision Team 

• Southwest Regional Comprehensive Center 

• Data Services Unit 

• Information Management Services Unit 

• Special Education Directors 

• AU data managers 

Revisions for FFY 2008 

The CDE is revising and/or adding improvement activities to better reflect current practices. 
Improvement activities are being added to continue through FFY 2010. 



Revised I improvement Activities/ Timelines/ Resources 



Activity 


Action Steps 


Timeline 


Resources 


1. Reprogram data 

collections to enhance 
functionality and improve 
ease of use for AUs. 


Devise project plan. 

Allocate resources for 
development and 
programming. 

Reprogram collections. 


FFY 2009 
FFY 2010 


1 nformation 
Management 
Services Unit 

ESLU General 

Supervision 

Team 

Data Services 
Unit 


2. Enhance training of all 
data collections to address 
technical needs along with 
count content needs. 


Evaluate content of past 
trainings. 

Develop training content. 
Develop training schedule. 
Conduct trainings. 


FFY 2009 
FFY 2010 


ESLU General 

Supervision 

Team 

Data Services 
Unit 


3. Conduct webinars to 
provide content to 
enhance data validity. 


Evaluate content of past 
trainings. 

Develop training content. 
Conduct trainings. 


FFY 2009 


ESLU General 

Supervision 

Team 


4. Add consultant to General 
Supervision Team to 
increase ability to provide 
TA to AUs. 


Post position. 

H ire position. 
Train consultant. 


FFY 2009 


ESLU General 

Supervision 

Team 
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SPP Template - Part B (3) 



Colorado 



Activity 


Action Steps 


Timeline 


Resources 


5. Provide individualized 
training to meet the needs 
of specific audiences (e.g., 
child find coordinators). 


Determine need. 

Evaluation previous training 
content. 

Develop training materials. 
Conduct training. 


FFY 2009 
FFY 2010 


ESLU General 

Supervision 

Team 

CDE Early 
Childhood 
1 nitiatives 
Team 


6. Require AUs to submit 
plans to address concerns 
regarding ability to submit 
valid and timely data to 
the CDE. 


Determine areas of concern. 

Develop rubric for data plan. 

Require AUs to submit plans. 

Review plans and provide 
feedback. 


FFY 2009 
FFY 2010 


ESLU General 

Supervision 

Team 
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